Difference between revisions of "User Tips"
(Created page with 'Put your tips here! At the end, add something like the following: <nowiki>-- yourname ~~~~~</nowiki>') |
(CN added based on helpful email from Scott) |
||
| Line 1: | Line 1: | ||
| − | + | =Benchmarking= | |
| + | ==Ensuring that you get non-IB nodes== | ||
| + | You can specify gigE only nodes using a "compute-eth" flag | ||
| − | <nowiki>-- [[User: | + | nodes=2:compute-eth:ppn=8 |
| + | |||
| + | and this will only allow the code to run on "gigabit only | ||
| + | nodes. So even if IB nodes are available it will sit in the queue. | ||
| + | |||
| + | By default (ie no property feature for the node) the scheduler (moab) is setup to use the gigE nodes first then the IB nodes. The scheduler configuration is ongoing but explicitly putting either "compute-eth" for ethernet or "ib" for infiniband nodes will guarantee the right type of node is used. | ||
| + | |||
| + | Also you can specify the type of interconnect directly on the mpirun line using mpirun --mca btl self,tcp for ethernet, so even if it was on an IB node it would still use ethernet for communication. Since the nodes are exactly the same except | ||
| + | for the IB card, any benchmarking would still be valid. | ||
| + | |||
| + | <nowiki>-- [[User:northrup|Scott]] ~~~~~</nowiki> | ||
Revision as of 11:57, 27 August 2009
Benchmarking
Ensuring that you get non-IB nodes
You can specify gigE only nodes using a "compute-eth" flag
nodes=2:compute-eth:ppn=8
and this will only allow the code to run on "gigabit only nodes. So even if IB nodes are available it will sit in the queue.
By default (ie no property feature for the node) the scheduler (moab) is setup to use the gigE nodes first then the IB nodes. The scheduler configuration is ongoing but explicitly putting either "compute-eth" for ethernet or "ib" for infiniband nodes will guarantee the right type of node is used.
Also you can specify the type of interconnect directly on the mpirun line using mpirun --mca btl self,tcp for ethernet, so even if it was on an IB node it would still use ethernet for communication. Since the nodes are exactly the same except for the IB card, any benchmarking would still be valid.
-- [[User:northrup|Scott]] ~~~~~