i have a linux cluster (10 node)..having OSCAR. now MPI and other communication r using same n/w. i want to make MPI use different n/w alltogether (diff set of n/w cards) and other communications (ssh,etc) diff n/w. so that communication gets faster. i dunno feasibilty of this project ??
This can easily be done if you give all your machines in your cluster two different IP addresses for the two physical networks. (I presume you _have_ two physical LANs for your cluster, right?)
Once you have two disjoint subnets for the two sets of IP addresses of your cluster, you can set up routing tables such that any communication attempted to Addr1 of host A will go over one physical network, and any communication to Addr2 of the same host A will go over the other network.
This can be trivially done, so feasibily appears certain. As far as the individual nodes on the cluster are concerned, they'll treat two different IP addresses for host A as two different computers; only you will know they both lead to the same place.
But do you have an application which saturates modern 100MHz Ethernet? The NSE PRISM system works in real-time handling complex work in one of the world's five largest exchanges (the NSE:)) in terms of number of trades, and we don't saturate it. PRISM uses MPI.
regards, Shuvam "built the PRISM MPI-based app for NSE" Misra :)