What hardware setup is required to use MPI with CUDA?

Question

I am new to MPI. I want use CUDA with MPI. I am having three PCs, each having one GPU, which I want to use for doing some simple processing (matrix multiplication).

But I am not sure what hardware setup is required to use MPI with CUDA? Please enlighten me.

Update I am asking this as many a place mentions clusters with infiniband. I do not have such a set up. I only have ordinary Lan that we have in offices. And above all the basic idea is to have a feel of how MPI and CUDA work together and do small small tests runs--irrespective of the performance.

Answer 1

One or more machines with nVidia GPUs that are capable of CUDA.

MPI and CUDA don't have anything to do with each other. You simply use CUDA within each MPI process.

Answer 2

But, but way of a followup to the OP's original question, if I may?

I realize that @gpuguy's Q was about hardware, but isn't it true that he must be running one of the OS options the Nvidia CUDA compilers supports? (IE, Linux, Win, OSX)

There is no OpenSource equivalent of CUDA, is there?