Unreal Engine 5 Tech Demo, Release Target Late 2021

Discussion in 'Console Technology' started by mpg1, May 13, 2020.

  1. John Norum

    Newcomer

    Joined:
    Mar 23, 2020
    Messages:
    61
    Likes Received:
    68

    [​IMG]
    [​IMG]







    https://devblogs.nvidia.com/gpudirect-storage/
     
    pharma, PSman1700 and Remij like this.
  2. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    43,374
    Likes Received:
    15,818
    Location:
    Under my bridge
    Broadly speaking. The point is PS5's SSD is fast and Sweeney made a note of it. It's also worth noting that PS5's solution includes optimised OS access and intrinsic compression, so it's performance goes beyond the basic 5 GB/s rate and may or may not be faster than high-end PC SSD. That's not a meaningful contribution to this discussion though; the fact that technically there may be faster solutions on workstation class hardware (which is inevitable in any comparison; 'PC' will always have a superior solution in some $10,000+ professional workstation configuration) is neither here nor there.
     
    ethernity, Recop and John Norum like this.
  3. Mitchings

    Newcomer

    Joined:
    Mar 13, 2013
    Messages:
    113
    Likes Received:
    172
    I'd assume that with 12 Channels, the chips themselves will be running a good bit slower than they otherwise would.
     
  4. PSman1700

    Veteran Newcomer

    Joined:
    Mar 22, 2019
    Messages:
    2,489
    Likes Received:
    771
    Radeon ssg? ;) Would a consumer version of that be possible, at humanly prices?

    Faster then ps5 solution even?
     
  5. John Norum

    Newcomer

    Joined:
    Mar 23, 2020
    Messages:
    61
    Likes Received:
    68
    depending on the DDR:

    DDR4 2133:17 GB/s raw
    DDR4 2400:19.2 GB/s raw
    DDR4 2666:21.3 GB/s raw
    DDR4 3200:25.6 GB/s raw

    Ps5 SSD have similar trasnfert rate with DDR2 667:5.3 GB/s

    of course DDR have a lot less latency
     
    PSman1700 likes this.
  6. JoeJ

    Regular Newcomer

    Joined:
    Apr 1, 2018
    Messages:
    964
    Likes Received:
    1,091
    From my perspective it is simple, no matter how it works exactly. But this is no disrespect against Epic - it is more a commitment of probable failure on my side, so the opposite.
    Just to make clear calling things simple depends on context, and mostly simple solutions are good solutions.
     
    jlippo and Shifty Geezer like this.
  7. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    43,374
    Likes Received:
    15,818
    Location:
    Under my bridge
    Simple solutions aren't always easy to come with, or easy to execute on either. It might take 20 years to come up with something simple and easy which can be reproduced in 6 months once it's finally been discovered/invented.
     
    Jov, jlippo, PSman1700 and 1 other person like this.
  8. Orion

    Regular Newcomer

    Joined:
    Feb 18, 2013
    Messages:
    355
    Likes Received:
    49
    not only what laptop but what settings.

    If patsu is still reading this thread, (I don't recall if he mentioned), did you manage to hear if he mentioned the resolution in the laptop version? Some sites are saying it was 1440p, others are saying he never said.
    COD probably has a lot of redundancy and might have 4k fmvs.

    Downloadable uncharted 4 npcs are about 100MB, some say the ue5 statue after compression is 200MB. If true that is in the same ballpark
    The ps5 can reach peak 22GB/s with compression not to mention the ps5's IO hardware allows faster access.

    The ps5 can reach peak 22GB/s with compression not to mention the ps5's IO hardware allows faster access.

    Games installed on ramdisk load no faster than sata ssds. The ps5 is substantially faster than sata at loading a game, thus it is faster than even a ramdisk solution. This is probably due to all the overhead bottlenecks Cerny mentioned exist, and solved with ps5 IO hardware.

    The games could work faster with ram in theory, but instead of installing to ram they'd need to be designed to work entirely from ram not loading from an install.
     
    #768 Orion, May 18, 2020
    Last edited: May 18, 2020
  9. Remij

    Newcomer

    Joined:
    May 3, 2008
    Messages:
    96
    Likes Received:
    114
    Because current gen games aren't designed to load and stream faster.
     
    Silenti, tinokun and BRiT like this.
  10. pjbliverpool

    pjbliverpool B3D Scallywag
    Legend

    Joined:
    May 8, 2005
    Messages:
    7,792
    Likes Received:
    1,075
    Location:
    Guess...
    Limited by PCIe transfer rates though. So 16GB/s max on gen3 and 32GB/s on gen3. Although there'll obviously be other traffic using that bus too.

    I'm really looking forward to the DirectStorage deep dives. It should answer a lot of currently unanswered questions.
     
    Silenti, turkey, BRiT and 1 other person like this.
  11. ThePissartist

    Veteran Regular

    Joined:
    Jul 15, 2013
    Messages:
    1,554
    Likes Received:
    506
    Right, but it needs to get into RAM in the first place.

    Standard PC SSD - RAM - VRAM

    Will that be faster and have less latency than SSD - VRAM?

    And besides, aren't there decompression steps in there too?
     
    #771 ThePissartist, May 18, 2020
    Last edited: May 18, 2020
  12. pjbliverpool

    pjbliverpool B3D Scallywag
    Legend

    Joined:
    May 8, 2005
    Messages:
    7,792
    Likes Received:
    1,075
    Location:
    Guess...
    People should really stop using that figure. Its impossible to hit that level of compression in a game environment in a sustained way. There's a reason why Sony states 8-9 GB/s.
     
  13. Orion

    Regular Newcomer

    Joined:
    Feb 18, 2013
    Messages:
    355
    Likes Received:
    49
    There are games that seem to be designed to take advantage of ssds, like star citizen. But practically all games even those designed for ssds do not load faster in nvme vs sata ssd vs ramdisk. Perhaps ALL developers are lazy and don't know nvmes exist, so don't optimize for that. Or perhaps all the bottlenecks Cerny mentioned exist are actually impeding any faster loading than sata ssd even on ramdisk. Thats the nature of bottlenecks.
     
    #773 Orion, May 18, 2020
    Last edited: May 18, 2020
  14. mrcorbo

    mrcorbo Foo Fighter
    Veteran

    Joined:
    Dec 8, 2004
    Messages:
    3,914
    Likes Received:
    2,614
    That's my expectation, at least until a significant portion of the PC hardware ecosystem is DirectStorage-capable.

    And that's just from a single memory channel. Gaming PCs would be dual channel.
     
  15. Billy Idol

    Legend Veteran

    Joined:
    Mar 17, 2009
    Messages:
    5,955
    Likes Received:
    784
    Location:
    Europe
    So out of curiosity, I was trying to estimate the amount of memory needed for the geometry of the statue they had in the demo. They said that the statue had 33 million triangles. Maybe someone knows exactly how the geometry is getting stored, but here is my estimate of the amount of data anyway:

    For a mesh consisting of triangles of a closed surface, I think the ration of number of tris and number of nodes is about 1:1. Hence, 33 million triangles should equate to rougly 33 million nodes that need to be stored.

    For a mesh node, you need three numbers in 3D, i.e. the x,y,z coordinates. So in total, we have about 99 million numbers to store for the statue.

    I am not sure if one gets away of storing the mesh in single precision (4 bytes) or if double precision is needed (8 bytes).

    So you get rougly about between 400 MB (SP) or 800 MB (DP) for the mesh geometry alone of this statue...right?
     
  16. Remij

    Newcomer

    Joined:
    May 3, 2008
    Messages:
    96
    Likes Received:
    114
    Nobody said devs were lazy. You program for the hardware that's common...

    System RAM is vastly faster in both transfer rates and latency than PS5's SSD... So Cerny can be right that there ARE bottlenecks (because of course there are) but it can ALSO be right that games simply aren't being designed atm to take advantage of the fastest NVMe drives and most certainly not RAMdisks.
     
    tinokun, turkey, PSman1700 and 3 others like this.
  17. manux

    Veteran Regular

    Joined:
    Sep 7, 2002
    Messages:
    2,059
    Likes Received:
    922
    Location:
    Earth
    I would imagine compression would do wonders for such a dense triangle soup. Organize data nicely(needed for streaming anyway) and the adjacent vertex values would be very similar and lend themselves really well to be compressed further. Doesn't even need to be very complicated compression mechanism to take advantage of close proximity of adjacent vertices. Perhaps that's one part where sw rasterizer comes in handy as they can do decompression in their rasterizer? Cost of decompression gets amortized over less memory accesses?
     
    #777 manux, May 18, 2020
    Last edited: May 18, 2020
  18. mrcorbo

    mrcorbo Foo Fighter
    Veteran

    Joined:
    Dec 8, 2004
    Messages:
    3,914
    Likes Received:
    2,614
    Laziness or an inability to realize a benefit from current PC hardware are the only two possibilities that come to your mind? You don't think current-gen consoles and many PCs not having SSDs has had an effect on developers choice to not push the envelope further on the use of streaming in their engines up to now?
     
    tinokun, PSman1700, BRiT and 2 others like this.
  19. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    43,374
    Likes Received:
    15,818
    Location:
    Under my bridge
    I'm not totally convinced by that. There are no patterns in the values so compression options are limited. As I understand it, mesh compression is lossy with slight quantization of values to produce compressible data.
     
  20. manux

    Veteran Regular

    Joined:
    Sep 7, 2002
    Messages:
    2,059
    Likes Received:
    922
    Location:
    Earth
    Imagine simple case where we divide mesh to blocks. Top left block would have index 0,0 and top right would be 256,256. This would naively give us 65536 blocks(ignore z for simplicity). We would also make seeks work on 1x1 blocks to allow streaming blocks as needed. Instantly the integer part of vertices on each block is same saving space. Inside each block we only need to store the decimal part. Now inside the block we could also sort the data so we find some compression on the decimal part. We know the mesh is super dense so difference between adjacent vertices should be very small.

    As the blocks are pretty small and geometry is super dense we could make more assumptions on how many bits are needed to store the decimal part. If data is sorted appropriately then even simple run length encoding would do wonders. I don't think math like assuming 32bit or even 16bit per vertice multiplied by count of vertices would apply. It's just way too naive considering how many ways there is to compress the data when knowing we have ridiculously dense geometry and we do want to make it streamable i.e. chunk it to blocks. Or do something more advanced.

    I have seen some papers which store geometry as textures and unwrap from texture. Could be unreal is using something way different than just regular vertices.
     
    #780 manux, May 18, 2020
    Last edited: May 18, 2020
    tinokun and turkey like this.
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...