Nvidia Hopper Speculation, Rumours and Discussion

MareNostrum 5 will also be the fastest AI supercomputer in the EU once in service.
BSC’s press release says that MareNostrum 5 will have “a peak performance of 314 [petaflops] and more than 200 petabytes of storage and 400 petabytes of active archive,” and Nvidia adds that the system is expected to deliver 18 exaflops of AI performance, making it the fastest AI supercomputer in the European Union.
 
I told it 6 months ago and it's one of the reason of Hopper/Ada big improvement in circuit design, clock speed and power consumption. It's an important competitive advantage over AMD on this generation
Nvidia has been using ML in h/w design for some time now AFAIK. Hopper certainly isn't the first.
 
"Automated" electronic design tools has existed for many years now so I fail to see what exactly was done that was much more special in this instance compared to other hardware designers ?
 
"Automated" electronic design tools has existed for many years now so I fail to see what exactly was done that was much more special in this instance compared to other hardware designers ?

In the linked article, NVIDIA claims that their reinforcement learning did circuit planning 25% smaller than a leading EDA tool.
Of course that could be a hand picked best cast scenario, but again in the article it's claimed that Hopper has nearly 13,000 instances of AI designed circuits. If the advantages in these instances are, say 15%, that's quite significant.
 
In the linked article, NVIDIA claims that their reinforcement learning did circuit planning 25% smaller than a leading EDA tool.
Of course that could be a hand picked best cast scenario, but again in the article it's claimed that Hopper has nearly 13,000 instances of AI designed circuits. If the advantages in these instances are, say 15%, that's quite significant.
If we take a closer look at their paper, the so called "commercial EDA tool" is better than PrefixRL at optimizing circuits for the lowest delay times.

What's the comparison like for other process technology outside of 8nm ? PrefixRL is strictly limited to optimizing parallel prefix circuits as well so you still need EDA tools for many other circuits in hardware design ...
 
"Automated" electronic design tools has existed for many years now so I fail to see what exactly was done that was much more special in this instance compared to other hardware designers ?
I guess AMD is using off the shelves Cadence and/or Synopsys ML optimisation plugins :

Nvidia has his own plugins and tools:
 
That doesnt make any sense. AMD has only started recently using DL for designing their chips. There was a news that they are using Google's infrastructure: https://www.googlecloudpresscorner....de-Additional-Scale-for-Chip-Design-Workloads
Have you actually read the article you linked? It has absolutely nothing to do with DL or AI or any such thing, it's just telling that AMD has decided to use Google for additional capacity on top of what they had. The hardware they're using in the Google Cloud is nothing special either, just Milan Epycs.
 
Back
Top