Nvidia DLSS antialiasing discussion *spawn*

Discussion in 'Architecture and Products' started by DavidGraham, Sep 19, 2018.

Tags:
  1. pjbliverpool

    pjbliverpool B3D Scallywag
    Legend

    Joined:
    May 8, 2005
    Messages:
    8,573
    Likes Received:
    2,928
    Location:
    Guess...
    Are you talking with DLSS or without now? Without DLSS then yes of course the PS5 should outperform a 2060/S in a non-RT game. I'm one of the people who's said that already in this thread several times. But I've not seen anyone making the same claim about a 2060S while using DLSS other than yourself. Given that DLSS can literally more than double performance in some cases I'd say it'd be unwise at best to make such a generalised statement.

    But even in reference to this specific game, if that is your claim I'm just not seeing how you're reaching it. There's no common frame of reference and there's no reliable way to to equate extra resolution to performance loss in specific percentage terms.

    I'm certainly curious to see how you're reaching this conclusion. In particular how you will explain that the PS5 in either quality or standard mode needs to drop as low as 1440p at times in order to maintain 60fps while the DLSS output on the 2060 is running with 125% more resolution at 4K in those instances and goes no lower than 41fps (very briefly) in the DF video. So that's essentially 41fps at 4K vs 60fps at 1440p. How do you conclude from that that one is substantially better than the other? And that's just comparing to the 2060, not the 2060S.

    In fact to look at this in a much simpler way, in the DF video (time stamped below) Alex points out that the performance uplift in his sample scene between native 4K and DLSS Quality and Performance modes are 31% and 50% respectively.

    50% more performance than a 2060 according to TPU puts you comfortably above 2080S performance while 50% more performance than a 2060S put you between an RTX3070 and a RX 6800. Is it your assertion that the PS5 is "objectively outperforming the RTX 3070 by a substantial margin"?



    Nvidia's own benchmarks corroborate that performance uplift here (note the 2060 slightely outperforming the 3060Ti with DLSS(P) activated.

    [​IMG]
     
    T2098, PSman1700 and pharma like this.
  2. neckthrough

    Newcomer

    Joined:
    Mar 28, 2019
    Messages:
    68
    Likes Received:
    171
    Perhaps you misread my post. I said exactly what you are saying here -- they are all approximations, and so it's fair to compare them. I did add the caveat that in some cases if one approximation is shown to be consistently inferior to another, then that observation must be factored into the discussion. But the discussion is legitimate.

    There's nothing to be "considered" here, this is not a matter of opinion. Native is not ground truth, as anyone trained in computer graphics and/or signal processing will tell you. Even the 64x supersampled render used to train DLSS is an approximation of ground truth, but it's a much closer approximation than native.

    100% agree that it's upsampled guesswork with its own issues and drawbacks. I also agree that it sometimes looks as good or even better than native or native+TAA. Once again, remember that DLSS is *not* trained to target a flawed native render -- if it did, it would, by construction, be consistently worse than native.

    Again, yes, but once again, caveat applies that if one approximation is shown to be consistently inferior to another then that needs to be called out.

    It's obviously not objectively equivalent -- the pixels are different. Subjectively, what most people seem to see is that in many implementations it trades blows with native. Therefore, they see them as equivalent-enough IQ-wise to use performance as the judging criterion. Obviously you disagree, and that's fair.
     
    xpea, HLJ, sonen and 4 others like this.
  3. Scott_Arm

    Legend

    Joined:
    Jun 16, 2004
    Messages:
    14,773
    Likes Received:
    6,919
    You're basically at the point of semantic arguments now. "Native" rendering is highly under-sampled, which is why we have aliasing and shimmering that needs to be removed in the first place. So all of these techniques like DLSS, TAA etc exist to try and improve a low sample image, and they all have different strengths and weaknesses. There's no purely objective way to evaluate them against each other, because it'll come down to personal preferences over blur, sharpness, ghosting and other artifacts.

    Also, frame rate is an image quality problem. You can't evaluate the whole of image quality without including frame rate. Tearing, frame pacing, MPRT, animation quality etc all matter.

    Why does anyone actually care if a PS5 is more or less powerful than a 2060 super anyway?
     
  4. BRiT

    BRiT (>• •)>⌐■-■ (⌐■-■)
    Moderator Legend Alpha

    Joined:
    Feb 7, 2002
    Messages:
    18,890
    Likes Received:
    21,292
    Can we remain on point from a technical perspective? {{ Please do not answer rhetorical questions }}
     
    Krteq, PSman1700 and Malo like this.
  5. Lurkmass

    Regular Newcomer

    Joined:
    Mar 3, 2020
    Messages:
    317
    Likes Received:
    355
    It's unique in the fact that there's no standardized equivalent or alternatives.

    Most AAA developers prefer D3D12 over Vulkan and there's plenty of reasons from tighter DXGI integration, not having to deal with renderpasses, mutable descriptors, and D3D is also usually the first to standardize new graphics features. Tools like Nsight also work better on D3D12 as well.

    Just because vendor specific extensions are comparatively less cumbersome on Vulkan doesn't make for a good reason among developers to use it over D3D12. In, fact IHVs would prefer to extend APIs as little as possible from a maintenance perspective. All titles sponsoring AMD's ray tracing implementation are using D3D12 so AMD decides that it's worthwhile to expose ray tracing hit tokens on that API since ISVs will actually use it. AMD won't do the same for Vulkan because no ISVs currently intend use vendor specific functionality since they didn't ask for it. In theory, vendors can implement any number of extensions they want to expose all hardware functionality on Vulkan. In practice, D3D12 might be arguably closer to matching the capabilities of hardware rather than Vulkan since ISVs will frequently request/use vendor specific functionality and IHVs will implement and maintain the said functionality on the driver side so in the end D3D12 exposes more hardware features when IHVs are more than willing to add extensions to AGS or NVAPI.

    I think we should end the discussion here since this is not the appropriate place to speak of these matters ...
     
  6. DegustatoR

    Veteran

    Joined:
    Mar 12, 2002
    Messages:
    2,231
    Likes Received:
    1,652
    Location:
    msk.ru/spb.ru
    Do we know what it does? The games which use it run on DXR on NV GPUs.
     
    PSman1700 likes this.
  7. Kaotik

    Kaotik Drunk Member
    Legend

    Joined:
    Apr 16, 2003
    Messages:
    9,812
    Likes Received:
    3,971
    Location:
    Finland
    I'm assuming the only DX12/RT extension they've listed is the one you're talking about, don't know what it does though
    https://github.com/GPUOpen-LibrariesAndSDKs/AGS_SDK
     
  8. OlegSH

    Regular Newcomer

    Joined:
    Jan 10, 2010
    Messages:
    536
    Likes Received:
    815
    Did some funky measurements today.

    Nioh 2 image quality analysis:
    https://imgsli.com/NDMxMTM
    On the left is a fragment of 9x SSAA "ground truth" image downsampled from 3840x2160 to 1280x720 with bicubic filtering as it doesn't add moire, aliasing and ringing like Lanczos.
    On the right is a fragment of 720p DLSS Quality image reconstructed from 853x480 to 1280x720 by accumulating and verifying samples from a large sequence of 853x640 images

    Here is another comparison:
    https://imgsli.com/NDMxMTQ

    Left one is the ground thruth 9x SSAA image again
    Right one is native 720p without any kind of AA

    And here is the third one just for fun:
    https://imgsli.com/NDMxMTA

    Left image is 70% rendering resolution (896x504) of 720p + single frame spatial upscale to 720p with Mitchell–Netravali filter + sharpening applied on top of the scaled image aka AMD's Fidelity FX + CAS or whatever it's called
    Right image is the DLSS Quality - a sequence of 853x480 images verified by NN

    It's kind of obvious which one is closer to the ground truth, but I also decided to make these fragments aligned so that I can capture some image quality metrics to verify that in more mathematical style.
    BTW, it was a huge PITA because the character on the screens above was animated and I wanted to catch DLSS in dynamic because on a static image it would have converged to SSAA in a matter of a few frames.

    Image fragments with original res and without any additional scaling:
    DLSS Quality vs 9x SSAA:
    PSNR (more is better): 35.7854
    RMSE (less is better): 1064.64
    MSE (less is better): 17.2956
    MAE (less is better): 651.178

    Native 720p No AA vs 9x SSAA
    PSNR (more is better): 32.671
    RMSE (less is better): 1523.79
    MSE (less is better): 35.4302
    MAE (less is better): 905.421


    The same image fragments, but 9х magnified:
    DLSS Quality vs 9x SSAA
    PSNR (more is better): 37.2114
    RMSE (less is better): 903.449
    MSE (less is better): 12.4547
    MAE (less is better): 561.239

    (Native) No AA vs 9x SSAA
    PSNR (more is better): 35.32
    RMSE (less is better): 1123.25
    MSE (less is better): 19.252
    MAE (less is better): 689.93

    So DLSS not only looks way more alike 9x SSAA, but it's also closer to SSAA image in terms of image metrics (less math difference between pixels).
    Though, no real surprises here since this is exactly how DLSS is supposed to work if everything is set up correctly - converge to the ground truth over time.

    I made quite a few screenshots, but, unfortunately, they all were with slightly different camera angles, so I wasn't able to perfectly align them, but in case you are wondering they are all here (including the screenshots above):
    https://drive.google.com/drive/folders/1ANx8HURnxFjp…ZYEtf?usp=sharing
     
    #1748 OlegSH, Mar 7, 2021
    Last edited: Mar 7, 2021
    xpea, T2098, Newguy and 21 others like this.
  9. DegustatoR

    Veteran

    Joined:
    Mar 12, 2002
    Messages:
    2,231
    Likes Received:
    1,652
    Location:
    msk.ru/spb.ru
    Sounds like a development oriented debug feature more than anything related to actual RT execution. I'm sure that NV has similar features in their NVAPI - in fact wasn't it mentioned around BFV launch that some RT game is using NV's intrinsics?

    Anyway, not sure why this is interesting. RDNA2 won't magically become 5X faster in RT through some feature of AGS or AMD would've pushed to include it into DXR 1.1.
     
    DavidGraham and PSman1700 like this.
  10. Kaotik

    Kaotik Drunk Member
    Legend

    Joined:
    Apr 16, 2003
    Messages:
    9,812
    Likes Received:
    3,971
    Location:
    Finland
    Maybe it'll be part of future DXR 1.2, we already know MS allows Xbox devs to skip DXR with its limitations and go straight for the money
     
  11. pjbliverpool

    pjbliverpool B3D Scallywag
    Legend

    Joined:
    May 8, 2005
    Messages:
    8,573
    Likes Received:
    2,928
    Location:
    Guess...
    This is superb work!
     
    sonen, pharma and PSman1700 like this.
  12. OlegSH

    Regular Newcomer

    Joined:
    Jan 10, 2010
    Messages:
    536
    Likes Received:
    815
    Thanks!
    I spent a few hours trying to capture screenshots with aligned character animation, this was exhausting, next time I will simply capture video. Also, need to write a script for SSIM.
     
  13. ThePissartist

    Veteran Regular

    Joined:
    Jul 15, 2013
    Messages:
    2,030
    Likes Received:
    996
    Excellent work. Glad you spent the time capturing a frame of an animated character. I notice a few minor discrepancies, but the DLSS upscale is outstanding. I doubt you'd notice the difference in motion.

    I'd be interested to see the results from a rotating camera if it'd be possible to screenshot accurately. It kinda looks like image breakup or blurring on some videos, but figure it's more likely to be YouTube compression.
     
    sonen likes this.
  14. DegustatoR

    Veteran

    Joined:
    Mar 12, 2002
    Messages:
    2,231
    Likes Received:
    1,652
    Location:
    msk.ru/spb.ru
    How do you skip DXR and go "straight to the money"? (Don't think that I'm ready to even go into "why".)
     
    PSman1700 likes this.
  15. Lurkmass

    Regular Newcomer

    Joined:
    Mar 3, 2020
    Messages:
    317
    Likes Received:
    355
    The standard PC DXR pipeline and the Xbox DXR pipeline aren't identical. With Xbox DXR pipeline, you can access to functionality 'beyond' what is offered with the standard PC DXR pipeline. I imagine that's what he meant.
     
  16. HLJ

    HLJ
    Regular Newcomer

    Joined:
    Aug 26, 2020
    Messages:
    393
    Likes Received:
    643
    Isn't that mostly "academic" talk, as I doubt any matter of "added functionality" will make up for the performance-deficit in the hardware?
     
    PSman1700 likes this.
  17. Lurkmass

    Regular Newcomer

    Joined:
    Mar 3, 2020
    Messages:
    317
    Likes Received:
    355
    Notice how I don't bring up the topic of 'performance' because that's not what the discourse is based on ? The argument was about capabilities while any claims about performance remains ambiguous for the most part ...
     
    w0lfram likes this.
  18. HLJ

    HLJ
    Regular Newcomer

    Joined:
    Aug 26, 2020
    Messages:
    393
    Likes Received:
    643
    Performance is part of the "capabilities" in my world.
    You could run DXR on Pascal, but since Pascal lack dedicated hardware...the functionality to run DXR might be there....but the performance is not.
    You cannot decouple anything from performance...unless you want a "biased" view shining in a certain way.

    So the added "functionality" to me is a moot point, as the performance...well we all know :nope:
     
    PSman1700 likes this.
  19. DegustatoR

    Veteran

    Joined:
    Mar 12, 2002
    Messages:
    2,231
    Likes Received:
    1,652
    Location:
    msk.ru/spb.ru
    Having additional shader intrisics doesn't mean that the pipelines aren't identical, it means that one of them have additional functions inside the same pipeline. And there can be many reasons for them to be there - not all of them are inherently "interesting".
     
    PSman1700 likes this.
  20. Lurkmass

    Regular Newcomer

    Joined:
    Mar 3, 2020
    Messages:
    317
    Likes Received:
    355
    Maybe the term 'features' would be a better word since it's absolutely true that console APIs and driver extensions expose more 'features' relative to the standard PC ray tracing pipeline.

    Well they are different pipelines because it's impossible to run the "exact same shaders" on different sets of hardware.
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...