NVIDIA discussion [2024]
- Thread starter pharma
- Start date
DavidGraham
Veteran
It continues.
How I imagine that meeting preparation went:
"How do we get them to spend tens of billions more on things we're going to make a lot of money from?"
"Say they'll make money and it'll help against the big bad!"
Next thing you know they'll be saying doctors recommend OpenAI and saying that it's good for you. It's cool to see the limits of what's possible being pushed but >100x great power consumption from today (about 30-40MW for Fugaku and Aurora) seems incredibly unsustainable and something that'll backfire in the next 10-15 years.
"How do we get them to spend tens of billions more on things we're going to make a lot of money from?"
"Say they'll make money and it'll help against the big bad!"
Next thing you know they'll be saying doctors recommend OpenAI and saying that it's good for you. It's cool to see the limits of what's possible being pushed but >100x great power consumption from today (about 30-40MW for Fugaku and Aurora) seems incredibly unsustainable and something that'll backfire in the next 10-15 years.
DavidGraham
Veteran
"Tesla intends to spend at least $10B on Al in 2024, on several compute projects: the supercluster in Austin, Texas (planned to house 50,000 H100 GPUs and 20,000 of Tesla's own D1 chip), an inference computer, and Dojo.
Of the $10bn, Musk estimated spending $5b on internal development, $3-4bn on NVDA GPUs alone, and the rest on residual infrastructure.
Of the $10bn, Musk estimated spending $5b on internal development, $3-4bn on NVDA GPUs alone, and the rest on residual infrastructure.
NVIDIA's Third-Largest Customer - Super Micro Computer (SMCI) - Reportedly Under A DOJ Probe As Its Annual Report Filing Delays Place Investors On Edge
Super Micro Computer's biggest client is NVIDIA, and its second-biggest client is an entity that is backed by NVIDIA.
wccftech.com
BlackRock, Microsoft, Nvidia, Blackstone and the Future of Global AI Infrastructure Investment
The astonishing surge of AI investment continues: Blackstone spends $16B in APAC to buy AirTrunk, while BlackRock puts down $30B to furnish its far-reaching GAIIP data center ...
www.datacenterfrontier.com
It makes sense but shows how convoluted the industry has become.
Typically... customer = product, client = service.
Corporate speak will blur the lines and make their own definitions when it suits them.
They're both right, I think you might have just misunderstood.
For SuperMicro, their biggest customer is NVIDIA. Meaning nobody buys more SuperMicro than NVIDIA does. Remember, NVIDIA actually has to buy servers, they don't make them, and apparently they buy their servers from SuperMicro. Also keep in mind SuperMicro does literally everything from building their own ASICs and motherboards to building entire physical datacenters, and literally everything in between.
For NVIDIA, their 3rd biggest customer is SuperMicro. Meaning only two other entities buy more NVIDIA than SuperMicro does. And having recently attended a conference with SuperMicro, their biggest profit comes from selling entire racks prestacked with servers and NVIDIA GPUs. Remember above when I mentioned SuperMicro builds datacenters? You can just call them, and say "I want a 2GW 250,000sqft datacenter and I want you to build it for me" and they can do the entire thing.
Nothing about those two statements is incongruent.
For SuperMicro, their biggest customer is NVIDIA. Meaning nobody buys more SuperMicro than NVIDIA does. Remember, NVIDIA actually has to buy servers, they don't make them, and apparently they buy their servers from SuperMicro. Also keep in mind SuperMicro does literally everything from building their own ASICs and motherboards to building entire physical datacenters, and literally everything in between.
For NVIDIA, their 3rd biggest customer is SuperMicro. Meaning only two other entities buy more NVIDIA than SuperMicro does. And having recently attended a conference with SuperMicro, their biggest profit comes from selling entire racks prestacked with servers and NVIDIA GPUs. Remember above when I mentioned SuperMicro builds datacenters? You can just call them, and say "I want a 2GW 250,000sqft datacenter and I want you to build it for me" and they can do the entire thing.
Nothing about those two statements is incongruent.
Similar threads
