Nvidia shows signs in [2023]

[Deleted member 2197]

NVIDIA Releases Open-Source NeMo Guardrails To Help Keep AI Chatbots Safe And Secure

To help wrangle the suddenly rapid emergence of advanced AI chatbots, NVIDIA is releasing an open-source solution that developers can use to guide generative AI applications.

hothardware.com

The rush by big tech to push out AI chatbots before they're fully cooked has it feeling a little bit like the Wild West. This comes with a plethora of concerns, not of the least of which is the spread of misinformation, but there are safety and security issues at play as well.

To help wrangle the suddenly rapid emergence of advanced AI chatbots, NVIDIA is releasing an open-source solution that developers can use to guide generative AI applications.

"Today’s release comes as many industries are adopting LLMs, the powerful engines behind these AI apps. They’re answering customers’ questions, summarizing lengthy documents, even writing software and accelerating drug design. NeMo Guardrails is designed to help users keep this new class of AI-powered applications safe," NVIDIA stated in a blog post.

 

[Kaotik]

NVIDIA Releases Open-Source NeMo Guardrails To Help Keep AI Chatbots Safe And Secure

To help wrangle the suddenly rapid emergence of advanced AI chatbots, NVIDIA is releasing an open-source solution that developers can use to guide generative AI applications.

hothardware.com

The idea is fine in theory, but it contains features on so slippery slopes of censorship it makes 1984 look like a childrens fairytale (then again, the developers could implement "guardlines" themselves so this just makes it easier I guess)

 

[DavidGraham]

https://twitter.com/x/status/1651684642859151376

 

[Deleted member 2197]

NVIDIA Says It Spends 20% Time on Hardware & 80% Time on Software As First DGX H100 Systems Roll Out

Today, NVIDIA announced that its first DGX H100 systems are shipping to customers all over the globe to advance AI workloads.

wccftech.com

NVIDIA has slowly been transitioning from a hardware company to a software company and provider. Making hardware such as GPUs and HPC systems is one thing however driving them is a more crucial task. For this purpose, NVIDIA has a vast software stack which is designed to squeeze every bit of juice out of its GPUs. Software suites such as NVIDIA's Base Command and AI Enterprise and the entire CUDA framework are just building blocks of the entire NVIDIA software stack available to its customers and partners.

 

[Deleted member 2197]

https://twitter.com/x/status/1653122569103454212

 

[Flappy Pannus]

Videocardz reports a 16GB 4060ti variant coming in July. I expected this would be their move, makes the most sense. Will still be a significantly lower performance tier than the 4070/ti so little risk to cannibalize those even with slightly more vram.

 

[pjbliverpool]

Videocardz reports a 16GB 4060ti variant coming in July. I expected this would be their move, makes the most sense. Will still be a significantly lower performance tier than the 4070/ti so little risk to cannibalize those even with slightly more vram.

Should make for some interesting VRAM comparisons with the presumably similarly performant 2080Ti / 3070.

 

[DegustatoR]

Videocardz reports a 16GB 4060ti variant coming in July. I expected this would be their move, makes the most sense. Will still be a significantly lower performance tier than the 4070/ti so little risk to cannibalize those even with slightly more vram.

Makes you wonder about prices though.
4070 is at $600 MSRP with retail offers likely dropping below that somewhat soon.
4060Ti 8GB should be at ~$450? Which would put a 16GB variant at launch dangerously close to what 4070s may be selling in retail.

 

[Man from Atlantis]

NVIDIA CEO Jensen Huang's Earnings Cut by a Small Margin

NVIDIA's co-founder and current CEO Jensen Huang will be receiving a slightly reduced salary this year, due to his company not meeting some financial goals. Team Green has published their report for the financial year of 2023, and several tech news outlets have been poring over the details - The...

www.techpowerup.com

 

[del42sa]

https://wccftech.com/nvidias-top-gpus-are-in-big-demand-for-ai-places-additional-orders-at-tsmc/

NVIDIA has placed additional wafer supply orders at TSMC due to the growing demand for its top AI GPUs such as the A100 & H100.

NVIDIA's AI Success Blows Up AI GPU Demand, Company Has To Put More Orders At TSMC To Retain Supply Balance​

 

[Deleted member 2197]

Cryptominers are looking at converting their mining farms into AI operations

With the crypto-mining boom over, companies are looking to pivot to AI. But there's a catch, only the most powerful GPUs are capable.

www.tweaktown.com

According to a new report at Bloomberg, crypto-mining company Hut 8 Mining has generated USD 16.9 million from AI clients looking for high-performance computing. Then there's Hive BLockChain which bought USD 66 million of graphics cards from NVIDIA for its AI plans.

With the AI boom, the computational cost of running complex AI models is staggering. According to a recent report from a few days ago, it's costing OpenAI over USD 700,000 daily just to keep the ChatGPT servers running.

There is a catch, though, only a tiny percentage of crypto-mining GPUs are up to handle complex AI processing, with the Bloomberg report stating that only 5% to 15% of existing crypto GPUs could be retooled for AI. So there's some expense to making the transition. "If you can reapply some of that investment in the GPU mining infrastructure and convert it to new cards and workloads, it makes sense," Hut 8 Chief Executive Officer Jaime Leverton told Bloomberg.

 

[DavidGraham]

According to DigiTimes sources, NVIDIA and MediaTek are in talk to design a new mobile processor.

MediaTek is expected to integrate an Nvidia GPU into its next-generation flagship mobile processor as early as 2024, according to industry sources.
In addition to co-developing mobile handset platforms to enhance AI and gaming functionalities of MediaTek’s application processors, MediaTek and Nvidia will also cooperate in developing WOA (Windows on Arm) platform products for notebook applications, said the sources.
— DigiTimes

It wouldn’t be surprising if both the Switch and MediaTek SoC had similar GPU architectures.

MediaTek rumored to adopt NVIDIA GPU architecture into next-gen flagship mobile SoC - VideoCardz.com

NVIDIA developing low-power GPU architecture for MediaTek According to DigiTimes sources, NVIDIA and MediaTek are in talk to design a new mobile processor. AMD could soon compete with NVIDIA in a new market segment. NVIDIA is said to be working with MediaTek for a next-gen flagship mobile...

videocardz.com

 

[DegustatoR]

It wouldn’t be surprising if both the Switch and MediaTek SoC had similar GPU architectures.

It would actually. I'd expect Nintendo to use something old and cheap again while MTK will likely want the best there is.

 

[Flappy Pannus]

Latest rumours are 4060ti 8GB at $399, 16GB at $499. Expected those prices as it's the only way it really makes sense in the lineup.

The 16GB 4060ti is close enough in price to the 4070 that it will be an obvious upsell to many, but the existence of the 16Gb model will buffer some of the harsh critique the 8GB model gets in reviews if it was the only variant. The 16GB 4060ti is in little danger of cannibalizing 4070 sales, but Nvidia can now appear to be responding to the vram concern.

These are Tis. 4060 will likely land at $300-350.

Whoops, typo. Meant the ti.

 

[DegustatoR]

Latest rumours are 4060 8GB at $399, 16GB at $499.

These are Tis. 4060 will likely land at $300-350.

 

[trinibwoy]

A 4060 for $299 will be interesting but it’ll probably be somewhere around $329.

$329 12.75TF 3060 on a 275mm^2 die succeeded by $329 15TF 4060 on a 145mm^2 die. Any bets on performance?

 

[pjbliverpool]

A 4060 for $299 will be interesting but it’ll probably be somewhere around $329.

$329 12.75TF 3060 on a 275mm^2 die succeeded by $329 15TF 4060 on a 145mm^2 die. Any bets on performance?

My guess is around 3060Ti performance.

 

[troyan]

Notebook 4060 (110W) gets ~11.000 points in Timespy graphics score. That is slighty lower than a 3060TI and ~25% faster than a desktop 3060.

 

[DegustatoR]

NVIDIA announces GeForce RTX 4060 Ti at $399, RTX 4060 to launch in July - VideoCardz.com

NVIDIA confirms GeForce RTX 4060 Ti 8GB costs $399, 16GB at $499 and RTX 4060 launches in July NVIDIA officially announces its mid-range RTX 40 stack featuring three graphics cards. The RTX 4060 Ti SKU will launch in two variants, either with 8GB or 16GB VRAM. That said, NVIDIA’s RTX 4060...

videocardz.com

 

[DegustatoR]

A 4060 for $299 will be interesting but it’ll probably be somewhere around $329.

Starting at $299 officially: https://www.techpowerup.com/308774/...-rtx-4060-starting-at-usd-299-16-gb-available