Nvidia Ampere Discussion [2020-05-14]
- Thread starter Man from Atlantis
- Start date
-
- Tags
- nvidia
D
Deleted member 13524
Guest
So from the specs it looks like A100 is running at 1425MHz.
That's lower than any V100 16FFN implementation I know of (1440-1455MHz), even though A100 is on 7nm and can reach 100W more than the highest consuming V100 (mezzanine 300W).
So with 400W maximum power and 19.5 FP32 TFLOPs, the A100 goes up to 20.5 W/TFLOPs. The 3 year-old V100 with 300W max power and 14.9 FP32 TFLOPs goes up to 20.1 W/TFLOPs.
The power efficiency on FP32 actually went down, when transitioning from 16FFN Volta to 7nm Ampere?
Or are these 400W only applicable when the GPU is running its tensor units in full parallel with the FP32 ALUs (and is that possible without hitting L2 cache / VRAM bottlenecks)?
This is just the first data point of many, but it could be that nvidia's delay in adopting 7nm is due to the fact that they can't boost higher clocks from 7nm than they could from 16/12FFN.
The dGPUs in Robotaxi seem to be substantially smaller, maybe around 600mm^2.
That's lower than any V100 16FFN implementation I know of (1440-1455MHz), even though A100 is on 7nm and can reach 100W more than the highest consuming V100 (mezzanine 300W).
So with 400W maximum power and 19.5 FP32 TFLOPs, the A100 goes up to 20.5 W/TFLOPs. The 3 year-old V100 with 300W max power and 14.9 FP32 TFLOPs goes up to 20.1 W/TFLOPs.
The power efficiency on FP32 actually went down, when transitioning from 16FFN Volta to 7nm Ampere?
Or are these 400W only applicable when the GPU is running its tensor units in full parallel with the FP32 ALUs (and is that possible without hitting L2 cache / VRAM bottlenecks)?
This is just the first data point of many, but it could be that nvidia's delay in adopting 7nm is due to the fact that they can't boost higher clocks from 7nm than they could from 16/12FFN.
@Nebuchadnezzar wrote that the A100 can go up to 400W, though he also assumed the GPUs in Robotaxi are the A100, which they don't seem to be if you compare their pictures.
The dGPUs in Robotaxi seem to be substantially smaller, maybe around 600mm^2.
D
Deleted member 13524
Guest
Of course it is. DP performance is the first number they're showing in the chip's specs list.
DegustatoR
Legend
It's impossible to say what matters and what not without knowing how many transistors are assigned to which h/w unit and how they contribute to the rated 400W power draw figure.
If we compare transistor numbers directly then there's an obvious transistors/watt gain with Ampere - but again it's hard to say how uniform that gain is or how it will translate into graphics oriented GPUs.
If we compare transistor numbers directly then there's an obvious transistors/watt gain with Ampere - but again it's hard to say how uniform that gain is or how it will translate into graphics oriented GPUs.
DavidGraham
Veteran
The 1st iteration of NVLink alone amounts to about 50w of power, which is the difference between V100 NVLink and V100S PCI-E power consumption figures. The 2nd iteration will probably need more power than that.
An obvious, and a huge one at that as well.
Tensor core count has been reduced in the A100, it now stands at 432 vs ~640 in V100, and they even run at lower clocks, we can infer from that that a significant amount of transistor budget has gone to the new tensor units in A100 to improve their IPC, also they now support significantly more formats, which also require significant transistor budget.
DegustatoR
Legend
Ampere GA100 TCs support FP64 now.
Often but not always that math is about matrix multiplies and that's the thing tensor cores accelerate.
ok, I thought I did see that in the spec sheet.
DavidGraham
Veteran
A100 supports two new significant data formats: Tensor TF32 and FP64. TF32 doesn't require code change, but FP64 does.
NVIDIA is instructing developers to migrate their code to the FP64 Tensor format to achieve 2.5X increase in throughput.
https://agenparl.eu/double-precision-tensor-cores-speed-high-performance-computing/
I an hour nVidia will talk about the Ampere architecture: https://www.nvidia.com/en-us/gtc/#webinar-schedule
NAck, that's during MS Build presentations...
D
Deleted member 2197
Guest
There's also free registration.
https://www.nvidia.com/en-us/gtc/session-catalog-details/?search=S21730
nVidia published the Ampere whitepaper: https://www.nvidia.com/content/dam/...ter/nvidia-ampere-architecture-whitepaper.pdf
Exactly. Unless we know what workloads result in 400w power consumption the numbers don’t tell us anything. If I had to guess, the peak power numbers probably correspond to max tensor throughout given the massive amount of data movement required.
D
Deleted member 13524
Guest
I still think it's odd that this new 7nm GPU is clocking lower than nvidia's very first implementarion of 16FF, but sure it could be due to it being so massively wide.
We'll wait and see how the consumer GPUs come out.
We'll wait and see how the consumer GPUs come out.
