Non-DLSS Image Reconstruction techniques? *spawn*

QW-Net doesn't reconstruct higher resolution images (i.e. supersampling without super resolution).

See below for more details:

 

That could be interesting for consoles, which lack tensor cores...

 

Although it does use the tensor cores.

 

So DLSS is ~10x faster on the same hardware? That's pretty crazy.

 

yea. That's what I think many of us were trying to say earlier in response to 'DirectML' as being an option; it's not the hardware or hardware support that is driving the speed. The DLSS model itself that is the IP that needs to be protected. It's not easy to replicate what Nvidia has done. 2ms is insane.

 

Series S would make things interesting in this regard. The Series X has half the INT4/8 throughput of an RTX 2060 meaning 4k upscale would take -5ms using DLSS or an equivalent model. Still potentially worth it at 60fps if you're upscaling from 1080p to 4k.

However the Series S with likely no more than 50% of the Series X throughout would be looking at ~10ms. Basically worthless at 60fps. So what happens if XSX does get a DLSS like solution and starts upscaling from 1080p to 4k? Where would that leave the S? I know the S would be targeting a lower resolution (1440p) but does that have a linear impact on the ML processing requirements? I'd guess not.

 

Series S is designed with an advanced hardware scaler to 4K. I don't expect DLSS to ever be used on the S. Even for lower resolution.
The resolution won't have an impact on model speed unfortunately. It shouldn't at least, but no one knows how Nvidia did it.

 

Indeed but if S is rendering at 1440p native, and a dev wants to use a DLSS type algorithm on the X to target an internal res of 1080p (or 1440p for that matter), that poses a problem. Rendering requirements on the S could potentially be higher than the X. They could always half the frame rate if X is targetting 60fps, but if its already at 30fps then the only route left is massive graphical compromises. Which seem to go against the principle of the S.

 

Yea. I see where you're going with this. I'm not sure what the options are for when they push both PS5 and XSX to the limit. Hopefully MS provides some tools there to help out (aka ML upres or something similar), but it's entirely possible that it's going to miss out on some things.

I can only assume if they manage to get ML upres working on XSX. They can make a faster model for XSS.
But using the same model on both, should run in the same time.

 

I guess GeForce Now, if offered as an option could potentially provide DLSS on the S.

 

So theres no need for tensor hardware for dlss?

 

No, just that the games already have DLSS support. Granted this is just a future possibility for consoles.
The requirements for Windows are:

 

But that's not providing DLSS on the S per se, it's just streaming games running on Nvidia hardware through the S.

 

I don't see any other way other than streaming given the S hardware setup.

 

It's not going to happen at all. The only alternative is MS providing a shader-based AI reconstruction that's similar. The original comment was a "DLSS type algorithm", not DLSS specifically since that's Nvidia only.

 

True, if MS can provide a decent AI reconstruction process for the S that would be ideal. However, AFAIK there has been no indication that MS will do anything other than support DirectML.

 

If they are working on something, they have some time. Maybe 2 more years before the consoles will start needing it and another 3 years after that when it's mature and pushing the envelope with 30fps titles.

 

Will console gamers accept 30fps? (especially in 5 years time) for a few years now anything less than a solid 60fps has been unacceptable to many in p.c space

 

They seem to be if they're into the PS5 exclusives.