Man from Atlantis
Veteran
At first I was gonna post in the Ada Lovelace thread but it's locked.
NVIDIA discussion [2024]
- Thread starter pharma
- Start date
nVidia released benchmarks of the ULMark "Gen AI" benchmark:
benchlife.info
NVIDIA：GeForce RTX GPU 高效能、低延遲，是 AI PC 最佳選擇 - BenchLife.info
NVIDIA 日前舉行「NVIDIA RTX for Windows AI」活動，分享 GeForc […]
benchlife.info
About expected, that roughly lines up with on paper FP throughput numbers
arandomguy
Regular
I'm not sure exactly how to frame this but...
I think people should be cognizant of how important memory (VRAM as it pertains to GPUs) are in creation workloads and AI specifically and ask how much benchmarks should reflect that.
Without bringing in crossvendor considerations for example the 4060ti 16GB is a much better (I can't emphasis this enough) GPU for this purpose than the 4070, 4070 Super and 4070 ti in practice that isn't reflected at all in that benchmark.
It's going to be interesting how the industry going forward (and this isn't Nvidia either, see others such as Apple) resolves trying to sell on AI with how they also product segment artificially with memory.
I think people should be cognizant of how important memory (VRAM as it pertains to GPUs) are in creation workloads and AI specifically and ask how much benchmarks should reflect that.
Without bringing in crossvendor considerations for example the 4060ti 16GB is a much better (I can't emphasis this enough) GPU for this purpose than the 4070, 4070 Super and 4070 ti in practice that isn't reflected at all in that benchmark.
It's going to be interesting how the industry going forward (and this isn't Nvidia either, see others such as Apple) resolves trying to sell on AI with how they also product segment artificially with memory.
nVidia released benchmarks of the ULMark "Gen AI" benchmark:
NVIDIA：GeForce RTX GPU 高效能、低延遲，是 AI PC 最佳選擇 - BenchLife.info
NVIDIA 日前舉行「NVIDIA RTX for Windows AI」活動，分享 GeForc […]
Nvidia criticizes AI PCs, says Microsoft's 45 TOPS requirement is only good enough for 'basic' AI tasks
Nvidia says its GPUs provide substantially better AI-performance than today's bleeding edge NPUs.
DavidGraham
Veteran
In January, Meta said it would buy 350,000 H100 GPUs from Nvidia in 2024, but a recent update from the company's head of AI, Yann LeCun, suggests that the company has bought even more H100 chips in recent months.
Speaking at the Forging the Future of Business with AI summit last month, LeCun and host John Werner said that Meta has bought an additional 500,000 GPUs from Nvidia, bringing its total to 1 million with a retail value of about $30 billion.
www.businessinsider.com
analyticsindiamag.com
Speaking at the Forging the Future of Business with AI summit last month, LeCun and host John Werner said that Meta has bought an additional 500,000 GPUs from Nvidia, bringing its total to 1 million with a retail value of about $30 billion.
How Nvidia is dominating an AI-obsessed earnings season without even reporting yet
Elon Musk said during Tesla's Q1 earnings call that the company will double the number of Nvidia AI chips it uses by year-end.
www.businessinsider.com
Meta Spends $30 Billion on a Million NVIDIA GPUs to Train its AI Models
In a “staggering” revelation, Meta AI chief Yann LeCun confirmed that Meta has obtained $30 billion worth of NVIDIA GPUs to train their AI models.
analyticsindiamag.com
Last edited:
Is it time to open the "Nvidia Rubin speculation thread" yet?
Man from Atlantis
Veteran
Top 10 IC Design Houses’ Combined Revenue Grows 12% in 2023
www.trendforce.com
Press Center - Top 10 IC Design Houses’ Combined Revenue Grows 12% in 2023, NVIDIA Takes Lead for the First Time, Says TrendForce | TrendForce - Market research, price trend of DRAM, NAND Flash, LEDs, TFT-LCD and green energy, PV
In 2023, the combined revenue of the world’s top ten IC design houses reached approximately $167.6 billion, marking a 12% annual increase. This growth was primarily driven by NVIDIA, which saw a remarkable 105% increase in revenue, significantly boosting the overall industry. While Broadcom...
www.trendforce.com
@Man from Atlantis Lol, combined revenue grows 12%. Really hides the story that most of them are losing significant revenue.
DavidGraham
Veteran
Emmmm, I think that story is inaccurate, in 2023 NVIDIA made 60.5 billion dollars, not 55.
Didn't notice the fine print? It has OEM/IP revenue excluded for NVIDIA
DavidGraham
Veteran
NVIDIA announced that their GH200 chip (Grace CPU + H100 GPU) has claimed 9 supercomputers wins in 2023/2024.
nvidianews.nvidia.com
NVIDIA Grace Hopper Ignites New Era of AI Supercomputing
Driving a fundamental shift in the high-performance computing industry toward AI-powered systems, NVIDIA today announced nine new supercomputers worldwide are using NVIDIA Grace Hopper™ Superchips to speed scientific research and discovery. Combined, the systems deliver 200 exaflops, or 200...
nvidianews.nvidia.com
https://wccftech.com/nvidia-blackwe...0x-faster-simulation-science-18x-faster-cpus/
NVIDIA Shares Blackwell GPU Compute Stats: 30% More FP64 Than Hopper, 30x Faster In Simulation & Science, 18X Faster Than CPUs
cheapchips
Veteran
A Taiwanese newspaper are reporting that Nvidia and MediaTek are partnering on a Snapdragon X competetor, built on TSMC 3nm.
www.pcgamer.com
I don't quite understanding why they're partnering on it, Nvidia make their own SoCs already, but maybe MediaTek's mobile SoC experience brings plenty to the table.
MediaTek and Nvidia are gearing up to tackle the AI PC market hand-in-hand, with an all-new chip
It's like the 1990s golden age all over again when you had more than two CPU vendors to choose from.
I don't quite understanding why they're partnering on it, Nvidia make their own SoCs already, but maybe MediaTek's mobile SoC experience brings plenty to the table.
https://wccftech.com/samsung-has-re...m3e-memory-qualification-tests-set-by-nvidia/
in meantime AMD signed deal with Samsung worth of 3 billions of dollars ...
https://www.viva100.com/main/view.php?key=20240423010007552
in meantime AMD signed deal with Samsung worth of 3 billions of dollars ...
https://www.viva100.com/main/view.php?key=20240423010007552
DavidGraham
Veteran
They've already partnered once to make a SoC with RTX GPUs for automotives, so they are extending the partnership to PCs.
On another note, Apple seems to be partnering up with OpenAI for AI services on Mac and iOS, which explains why Microsoft is doubling up their purchase of NVIDIA GPUs. Apple users will require more hardware to satisfy their demands.
Last edited:
cheapchips
Veteran
There's an element with automotive where it made obvious sense. MediaTek are already have infotainment relationships and Nvidia's autonomy links into that. I can't see the same angle with chips for Windows laptops. Nvidia have relationships with those companies already.
