Tokyo Tech Builds First Tesla GPU Based Heterogeneous Cluster To Reach Top 500

How long you think it is before nearly all in top500 are gpu accelerated? I'd say 2-3 years.

 

It's interesting they did not go with Clearspeed this time around. I'm thinking Nvidia probably gave them a better deal. Clearspeed does have the new CATS 700 1U systems with comparable performance to Nvidia's 1U solution.

 

RudeCurve: hadn't heard about that system before, but it makes for a very interesting architecture comparison.

CATS 700: 1,100GFLOPS DP (? SP), 24GB RAM, 96GB/sec bandwidth
Tesla S1070: ~333GFLOPS DP (~4,000GFLOPS SP), 16GB RAM, 400GB/sec bandwidth

They only thing that is equivalent between the two is the amount of RAM. Clearspeed has a huge DP FLOPS advantage, while NV has a huge bandwidth advantage and probably has a large SP FLOPS advantage.

Real world numbers for these two architectures will be extremely different based on if the workload is compute or bandwidth bound.

Edit: also I wonder how long before AMD gets ATI onto the list.

 

I don't know about the architecture of Clearspeed processors. But for GPUs, because they have relatively smaller internal memory (including registers and share memory), many workloads are going to be more bandwidth bound then on normal CPU. If Clearspeed suffers from similar problem, then I'd say the bandwidth advantage is probably quite important.

 

Ooh, Linpack on GPUs! I didn't even know they had a package for that. I wish they'd make it available, just for novelty's sake..

I thought the lack of ECC memory was an obstacle to using GPUs in production?

 

That'd be quite the novelty, producing incorrect results and then burning out the GPU in minutes

It is an obstacle, but not an insurmountable one.

Look at the GPU client for FAH. Frequent checkpoints with result verification are the answer, here. Some performance is lost of course.

 

Really? The so-called 'Intel Burn Test' (Linpack) runs on a single processor just fine, and reports the correct FLOPS results along with correct mathematical results as long as it's not overclocked beyond stability (so a nice stability test). Even if it's made for clusters, shouldn't it be possible to run this on a single board as well?

I really want to test the 8800GTX and get the real numbers now But I guess, perhaps this is a 64-bit GT200 only implementation..

 

My point is that GPUs were not designed with such precision in mind. Where rounding errors are unacceptable in the CPU arena, they are a fact of life for GPUs.

 

Whether GPU was designed with that precision in mind is not important. What's important is whether it is designed with that precision.

For example, NVIDIA claims that GT200 supports full IEEE 754 precision when doing double precision, and some operations (basically add and multiply) has full precision when doing single precision. These are probably good enough for some operations, depends on what you want to do and your algorithms.

ECC is another problem when you are using a lot of devices in parallel and operates continually for a long time. This is actually what NVIDIA can do to differentiate Tesla and other consumer level hardwares.

 

F@H operates in a way that makes it quite different from an HPC center.
The computation is done on a wide swath of hardware, for which:
1) maintenance of said hardware is not handled by F@H
2) paying for the maintenance of said hardware is not done
3) there's mostly no physical plant, lower utilities
4) the economic model, such as it is, different than a supercomputer for a proprietary client might have

I haven't seen the figures of much of F@H's FLOPs finally resolved to verified result FLOPs.
I suppose we'll see. Some workloads won't mind the error, and in some cases the lowered yield due to checkpointing might not be prohibitive.
A university with academic interest in GPGPU is not the primary test of the extendability of the concept.

A flood of crap FLOPs that happens to be free doesn't look the same if it is constrained by physical and financial limits, it has to be maintained, and it ceases to be free.