NVidia Ada Speculation, Rumours and Discussion

Ampere has an over abundance of flops for gaming. It's probably because the memory subsystem can't keep up. It wouldn't make sense to add even more flops to Ada. If SM performance increases significantly it should be "almost" all for RT.

 

In that case, we would see bigger differences, for example between 3080 and 3080 12 GB.

 

https://chipsandcheese.com/2021/05/13/gpu-memory-latencys-impact-and-updated-test/

Ampere's small cache and VRAM's latency are the main reasons why performance doesn't scale well enough despite the increased CUDA cores. They inevitably increased the cache size in Ada.

 

I wasn’t referring to VRAM.

 

Ada will be more powerful than previously expected..

 

With 600 - 900W TDP I can't see a reason why it wouldn't

 

Kicks like a mule to haters

 

Kopite has good info and a valid source but Lovelace was never a "simple Ampere refresh". The changes that Lovelace carries could not be made half way into the project. I guess Kopite's issue is that he only has a high level overview of future products, which is what Nvidia shows to its partners. Something basic like number of SMs is known a year in advance by people under NDA. But SM deep dive arch and new compute/logic functions are kept very close to Nvidia engineers chest. For example Hopper transformer engine, Asynch tensor thread scheduler and DPX instructions are a close garden of very few inside Nvidia and impossible to leak before announcement.

 

It always amuses me when leakers claim that “plans changed” as if they have perfect information on what those plans are in the first place.

 

Await the launch of the new RTX hardware, thats when my quoted line will happen.

 

So basically we don't know anything, even though a lot of confidential things has been leaked by hackers.

 

Kopite7kimi was spot on about initial Ampere lineup high level configurations (missed the doubling of FP32 though) but I think that his sources has gotten rather bad in everything which followed.
For Lovelace he's just guessing from some high level numbers at the moment IMO.
With chips supposedly going into tapeouts any day now there's exactly zero chance of them getting any major changes between now and the majority of 2021. It is highly likely that Lovelace lineup was feature locked back in 2020 in fact.

 

Leakers have never been all that accurate, some things are a hit some are a miss. Its not really leaking its guesswork. Remember the next-gen console speculation-topic days?

 

Saving PAM4 Bus Energy with SMOREs: Sparse Multi-level Opportunistic Restricted Encodings | Research (nvidia.com)

 

I assume kopite is implying that AD102 is more than 18K FP32 CUDA “cores”. Maybe Nvidia doesn’t mind being memory latency bound in games as long as compute bound workloads benefit from the excessive flops. GA102 is a solid 30% faster than Navi 21 in those.

What are the latest Navi 31 rumors saying? 5120 cores per GCD?

 

Are there any compute bound games? What is the most common bottleneck for games if that can be answered.

 

As with any game so far, not many use current generation hardware capabilities.

 

I'm curious as to what the current bottlenecks are. Bandwidth is commonly mentioned but Nvidia GPUs have consistently scaled better with core OC as opposed to memory since at least Kepler. 3090 has 55% more compute and 83% more bandwidth while a 6900 has 30% more texel rate and 50% more pixel fill. Infinity Cache eats into the bandwidth advantage but not completely.

 

Seems to be what rumors say with Navi 31 having 3 GCD's for up to 15,360 cores.

AMD's next-gen GPUs may deliver 130% performance jump | Digital Trends

That article appears to be using Moore's Law Is Dead as its source.

Regards,
SB