Realtime AI/ML game technologies *spawn

well, I guess we could be there in 10ish years time or so.
At this point I think the debate is if these AI models can extend to the intended outcomes or if they are fundamentally limited and will never achieve correctness, requiring AI to be thought of applied differently. To date, all showcases (I've seen) have shown 'more of the same', so extending the quantity of content but not really the quality. I'd rather see one video without the blobbing and hallucinations and AI-isms than dozens more dream-like takes on different games. One thing severely lacking so far is interaction. Recreated games are largely videos of someone traversing an environment. They also completely lack HUDs! ;)
 
Tom Peterson from Intel is hinting they are developing a technology that uses AI to reduce frame latency. He also hints strongly at using AI to render the entire game from a series of rendered frames.
 
At this point I think the debate is if these AI models can extend to the intended outcomes or if they are fundamentally limited and will never achieve correctness, requiring AI to be thought of applied differently. To date, all showcases (I've seen) have shown 'more of the same', so extending the quantity of content but not really the quality. I'd rather see one video without the blobbing and hallucinations and AI-isms than dozens more dream-like takes on different games. One thing severely lacking so far is interaction. Recreated games are largely videos of someone traversing an environment. They also completely lack HUDs! ;)
I think AI will be an excellent complement to standard-built games. I think I'm not wrong if I state that it will be an essential component of games in the near future and it will stay like that. But I don't think AI alone will be sufficient to create a base game ever: it'll handle specific aspects in engine-built games, such as interactions, procedurally generated stuff and even graphical features such as volumetric simulations, final improvement of IQ and framerate, etc.

EDIT: I'm talking about realtime AI generated video, not about AI generating 3d contents that one can later access, use or play, which can definitely be a thing, as well.
 
Nvidia released a paper on an alternative to Gaussian splatting that leverages the HWRT capability of existing GPUs.


It's interesting that HWRT capability can still be useful even in a rendering paradigm that isn't based on triangle meshes.
oh man, nVidia are the best and will ever be for a long while. Not an nVidia owner but I can't help but admire how many years of advantage they have over the competition.
 
Not really convinced by the new transformer model for DLSS. 4 times the cost versus the CNN model? Don't transformer models tend to "lose focus"?

Also that would mean something like 2 milliseconds on a 4090, which is acceptable, but on a 4060? I guess we'll see.
 
The first application of in game AI enhancement: RTX Neural Faces, explained below ...

Kinda falls down in the intro when they claim the tech generates photorealistic faces and yet I'm clearly looking at a computer game. ;) It does point to how ML can be used alongside traditional rendering and does improve the base version, particularly in subtle mouth detail, but then their examples are also full of wonk as keeps happening with generative AI. The multi-face examples are full of instabilities particularly on the teeth, and presumably this is a current-best-case showing.
 
Not really convinced by the new transformer model for DLSS.

All the modern video gen models are transformer based AFAIK and especially the Chinese ones are capable of some amazing realism in detail (it just breaks down in composition and behaviour, but that's not so important for interpolation/extrapolation).

The solution space in AI is so scarily huge and training so expensive, that as soon as people find something which works they tend to just want to iterate on it (and of course in NVIDIA's case it has to leverage the tensor cores too). That's a large part why CNN lasted so long, but I don't think it will stand the test of time.
 
Back
Top