Assembling my 32 GPU RIG Part 2

Now all 4 nodes are installed. Due to lack of availability of GTX295 cards only 8 GPU’s are installed. Total number of GPU’s will be 32 (4 nodes per 4 double GPU GTX295 cards = total 32 GPU’s). Cooling panel will be added probably next weekend.

 

Estonia Donates 32 GPU Supercomputer, 4 nodes and 8 GPU's installed

Estonia Donates 32 GPU Supercomputer, 4 nodes and 8 GPU's installed

 

 

Typical 1 node configuration (nodes ED01 – ED04):

All nodes are interconnected via Cisco / Linksys rackmount switch. Power is distributed via 2 independent 240V rails.

 

62 000 PPD, with 8 GPUs (total 32 GPUs in near future)

62 000 PPD, with 8 GPU's (total 32 GPU's in near future)

All nodes have local work directories on local hard drive due to added authonomy and failure tolerance. FahMon is installed to ED01. All work directories are shared to network and made accesable to FahMon to display aggregate report and PPD figure.

Every node is also remote accessable by LogMeIn. Its easy to check from the office or home rigs GPU teperatures and other parameters.

7 Comments

  1. What made you change the power supply configuration? Last I heard you were using a thermaltake 1500W?

  2. I made some math and did it mainly because of cost reasons and secondly I got also better current headroom and load balancing reasons. I will post analysis, but 2 x 850W supplies are much cheaper than one 1600W supply. There is trick with controlling-synchronising second supply, but it’s doable.

    Jaak

  3. Ahh, reason succeeded over convenience😉 Keep up the good work!

  4. Thanks, it’s always exiting from the comfort zone, it’s hard…

    Jaak

  5. Ok, this topic is now fully covered here: https://estoniadonates.wordpress.com/2009/04/02/dual-psu-pc-system/

  6. Hello, nice article! I will keep reading your site😉

  7. Wow that was strange. I just wrote an incredibly long comment on https://estoniadonates.wordpress.com/2009/03/31/assembling-my-32-gpu-rig-part-2 but after I clicked submit my comment didn’t appear. Grrrr… well I’m not writing all that over again. Regardless, just wanted to say fantastic blog!


Comments RSS TrackBack Identifier URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s