Blazing Fast NVMEs and Direct Storage API for PCs *spawn*

Discussion in 'PC Hardware, Software and Displays' started by DavidGraham, May 18, 2020.

  1. Tensor cores consist of tiny ALUs designed for handling small variables (maximum FP16), focused on ML inference. Why would these be good for decompression of large datasets? Is there any research pointing to successfully using tensor cores for data decompression?

    Same goes for INT8 and INT4 processing. Quad-rate INT8 just means it performs four INT8 operations in parallel, not that a single INT8 operation runs 4x faster.
    I'm yet to see how data decompression can become infinitely parallel like graphics rendering or NN learning or NN inference.

    For example, the Switch got a significant boost in loading times when Nintendo allowed the CPU cores to go up to 1.9GHz in loading screens. That's a boost coming from higher single-threaded performance. If the TX1 GPU's 256 shader cores with 2xFP16 throughput were any good for data decompression then it would have been implemented, as the shader cores are AFAIK mostly unused during loading screens.


    Dual issue FP32 just means more threads working in parallel, not higher single-threaded performance on FP32. The previous point still stands.
     
  2. cheapchips

    Veteran

    Joined:
    Feb 23, 2013
    Messages:
    2,493
    Likes Received:
    2,665
    Location:
    UK
    /Laughs at people who future proof their PC's.
     
    egoless and Picao84 like this.
  3. Infinisearch

    Veteran

    Joined:
    Jul 22, 2004
    Messages:
    779
    Likes Received:
    146
    Location:
    USA
    Block based techniques or as
    might have suggested (MKV is a container format... don't remember alot about those) like video compression the constant type frames and intermediate or dependent frames. In addition I'm pretty sure some domain specific ones are easily parallelizable.

    Just wondering are these fixed function or fully programmable?
     
    PSman1700 likes this.
  4. iroboto

    iroboto Daft Funk
    Legend Subscriber

    Joined:
    Mar 6, 2014
    Messages:
    14,833
    Likes Received:
    18,632
    Location:
    The North
    I am crying. Should have waited a little longer
     
  5. Jawed

    Legend

    Joined:
    Oct 2, 2004
    Messages:
    11,708
    Likes Received:
    2,132
    Location:
    London
    You are ignoring parallelised queuing, priority control and latency. You're also ignoring GPU memory fragmentation problems.
     
  6. PSman1700

    Legend

    Joined:
    Mar 22, 2019
    Messages:
    7,118
    Likes Received:
    3,088
    Always best to wait out when theres a generational shift. I'm sure you won't have to replace everything though.
     
    egoless likes this.
  7. fehu

    Veteran

    Joined:
    Nov 15, 2006
    Messages:
    2,067
    Likes Received:
    992
    Location:
    Somewhere over the ocean
    What? GPU can be linked directly to CPU and main memory, why the need for a new setup?
     
  8. Betanumerical

    Veteran

    Joined:
    Aug 20, 2007
    Messages:
    1,763
    Likes Received:
    280
    Location:
    In the land of the drop bears
    Yeah i don't get this either, surely there can be PCIE transfers between the NVMe device and the GPU directly.
     
  9. PSman1700

    Legend

    Joined:
    Mar 22, 2019
    Messages:
    7,118
    Likes Received:
    3,088
    There's probably more to it, hence the need of a new mainboard.
     
  10. Jay

    Jay
    Veteran

    Joined:
    Aug 3, 2013
    Messages:
    4,029
    Likes Received:
    3,428
    When it said supported pc's, could be talking about nvme drives, types, i.e. when it says some need less operations etc.
    Even if new hardware is required to take full advantage of direct storage, I would expect current systems with applicable DX12U gpu's to see a big boost in supported games.
    Games will still be limited to fast loading for a while yet, I don't expect gameplay changes for a while.

    So, don't feel down about recent upgrades yet....
     
  11. iroboto

    iroboto Daft Funk
    Legend Subscriber

    Joined:
    Mar 6, 2014
    Messages:
    14,833
    Likes Received:
    18,632
    Location:
    The North
    Fear in need of a new mobo.
     
    Silenti and PSman1700 like this.
  12. PSman1700

    Legend

    Joined:
    Mar 22, 2019
    Messages:
    7,118
    Likes Received:
    3,088
    It's the most work, but not the most expensive :p I'm going to wait atleast, before plunging in. If i have to upgrade then there will be a 3090 24GB 40TF in there, il sell the old stuff then. Wasn't planning this originally but ok.
     
  13. fellix

    Veteran

    Joined:
    Dec 4, 2004
    Messages:
    3,552
    Likes Received:
    514
    Location:
    Varna, Bulgaria
  14. Dictator

    Regular

    Joined:
    Feb 11, 2011
    Messages:
    681
    Likes Received:
    3,969
    https://devblogs.microsoft.com/directx/directstorage-is-coming-to-pc/
    Emphasis is mine.
    It seems like direct storage is about addressing existing IO "hang ups" on PC and leveraging the special nature of NVMe drives. I see no reason to fret or assume it is directly worse.

    What do you mean by GPU memory fragmentation problems?
     
    egoless, pharma, BRiT and 1 other person like this.
  15. PSman1700

    Legend

    Joined:
    Mar 22, 2019
    Messages:
    7,118
    Likes Received:
    3,088
    I'm far from an expert, but it seems like NV has their own answer to the SSD tech in consoles. They have a stake in pc gaming and probably invested alot into this tech. Frankly, just going by both sony and NV PR showcasings, the NV SSD tech seems more flexible and even faster.
     
  16. DavidGraham

    Veteran

    Joined:
    Dec 22, 2009
    Messages:
    3,976
    Likes Received:
    5,210
    It appears that only GPUs with tensor cores "RTX" will be able to accelerate DirectStorage. Microsoft only mentioned them for now, RDNA2 GPUs with ML instructions are not mentioned so far.
     
    PSman1700 likes this.
  17. Malo

    Malo Yak Mechanicum
    Legend Subscriber

    Joined:
    Feb 9, 2002
    Messages:
    8,929
    Likes Received:
    5,528
    Location:
    Pennsylvania
    You know it could just be that no RDNA2 GPUs are on the market yet so they can't mention any capabilities of them. But I understand your need to push everything Nvidia and RTX.
     
    Deleted member 13524 likes this.
  18. pjbliverpool

    pjbliverpool B3D Scallywag
    Legend

    Joined:
    May 8, 2005
    Messages:
    9,235
    Likes Received:
    4,259
    Location:
    Guess...
    P2P DMA is supported between any 2 PCIe devices on Zen/Zen+ platforms and presumably Zen 2 as well. I'm not sure about Intel.

    However that's assuming the data is transferred via P2P DMA. I don't think that's been confirmed. While the diagrams do suggest completely cutting out the CPU and system memory, that may just be representative of the amount of overhead that is removed from that process.

    The exact wording of the press release is open to interpretation. The sentence "DirectStorage will be supported on certain systems with NVMe drives" could simply mean you need an NVMe drive. Although I expect Windows 10 is also a requirement, probably a recent version of it. And possibly a DX12 capable GPU?
     
    PSman1700 likes this.
  19. DavidGraham

    Veteran

    Joined:
    Dec 22, 2009
    Messages:
    3,976
    Likes Received:
    5,210
    No need to be snarky, Microsoft announced that Xe and RDNA2 GPUs support DX12U well before their presence in the market, they didn't do the same here.
     
    PSman1700 likes this.
  20. Jawed

    Legend

    Joined:
    Oct 2, 2004
    Messages:
    11,708
    Likes Received:
    2,132
    Location:
    London
    Do you know what disk fragmentation is? GPUs have the same problem with their memory. This is one of the reasons why Vulkan/DX12 programming is difficult, since developers are now fully exposed to the memory fragmentation problem.
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...