Sony VR Headset/Project Morpheus/PlayStation VR

Discussion in 'VR and AR' started by jayco, Mar 19, 2014.

Tags:
  1. DSoup

    DSoup meh
    Legend Veteran Subscriber

    Joined:
    Nov 23, 2007
    Messages:
    10,972
    Likes Received:
    5,794
    Location:
    London, UK
    Ah, but Sony don't need to work within the limits of HDMI. Aside from being a connector pin layout, HDMI is a software stack but it's a standard that only exists for interoperability between different devices which is a luxury they don't need for PS4 to Morpheus (or its breakout box).

    HDMI is also something of a compromise to allow support of different things requiring different bandwidth - the video in 2D or 3D, an ethernet channel, the audio, the audio return channel, control lines and miscellaneous data. HDMI 1.4 has a raw bandwidth of 10Gbps, I wonder if this is enough to send two distinct 1080p frames at 60Hz - probably if you've not sending complete full frames (i.e. the cockpit also consumes the bottom 25% of the screen) and you've not simultaneously trying to send 5.1 or 7.1 lossless audio. :runaway: Although if you throw out HDMI you basically rule out PC compatibility.

    But I'm more curious how an approach like this would complicate the rendering pipeline complexity. For example if you're producing two distinct panes but there's light, shadows or reflections etc. from one (the world) impacting the other (the cockpit overlay), how that have an impact? Will this complicate AA?
     
  2. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    40,709
    Likes Received:
    11,163
    Location:
    Under my bridge
    6 MB a frame at 24 bit colour. 373 MB/s for one frame @ 60Hz, 746 MB/s for stereoscopic video. There'd be enough for a full screen 2D overlay.
     
    temesgen likes this.
  3. DSoup

    DSoup meh
    Legend Veteran Subscriber

    Joined:
    Nov 23, 2007
    Messages:
    10,972
    Likes Received:
    5,794
    Location:
    London, UK
    Cool. And it's likely you wouldn't need to do send two 1920x1080 frames, not unless you had a very intricate overlay that covered the entirety of the screen.
     
  4. turkey

    Regular Newcomer

    Joined:
    Oct 21, 2014
    Messages:
    739
    Likes Received:
    429
    I think I have the total wrong end of the stick then as I was under the impression I saw a slide where Sony had this task on the ps4 gpu and as such would have access to this and returning movement data from the hmd, thus I had assumed and this is probably fatal that the gpu did all the game and frame and the display just delt with the CA and lense correcting.

    This seemed logical to me for cost and because we know Sony has a fair chunk of compute and many queues to slip this in so it may be practically invisible performance wise which seems to fit with their quote about it being best to leave always on and such.

    BTW thanks all for being tolerant of a lay person who struggles with some of the tech jargon.
     
  5. Daozang

    Regular

    Joined:
    Aug 6, 2007
    Messages:
    894
    Likes Received:
    140
    Location:
    Athens
    From hands on impressions, most people feel that the image is suficiently sharp compared to other devices.
    But shouldn't reprojection technology introduce artifacts and motion blur?
    How accurate can a frame be, based on previous frames and sensor data?
     
  6. chris1515

    Veteran Regular

    Joined:
    Jul 24, 2005
    Messages:
    3,495
    Likes Received:
    2,121
    Location:
    Barcelona Spain
    The London Heist demo(Time Crisis like demo) was 60 fps reprojected to 120 fps. The robot demo was 120 fps.
     
  7. Scott_Arm

    Legend

    Joined:
    Jun 16, 2004
    Messages:
    13,276
    Likes Received:
    3,725
    The best huds I've seen in VR demos were transparent and in the peripheral edges, so you have to actively look at them to really see them.
     
  8. DSoup

    DSoup meh
    Legend Veteran Subscriber

    Joined:
    Nov 23, 2007
    Messages:
    10,972
    Likes Received:
    5,794
    Location:
    London, UK
    I think it's fair to say that when it comes to specifics, the unknowns far outnumber the knowns. Much of this is just spitballing, or because this is B3D, education speculation ;)
     
    turkey likes this.
  9. holsty101

    Regular

    Joined:
    Dec 22, 2003
    Messages:
    289
    Likes Received:
    17

    As I understand it it's not actually a new frame, it's repositioning the last frame with the latest movement data from the hmd, that's what it sounded like in the eurogamer article anyway.
     
  10. DSoup

    DSoup meh
    Legend Veteran Subscriber

    Joined:
    Nov 23, 2007
    Messages:
    10,972
    Likes Received:
    5,794
    Location:
    London, UK
    Well it's at least that. How much smarter it is than that remains to be seen! :yep2:
     
  11. eastmen

    Legend Subscriber

    Joined:
    Mar 17, 2008
    Messages:
    9,983
    Likes Received:
    1,496

    No one has used one right after the other yet. So its really hard to tell what could be hours between them or in some cases with crystal cove months between using them.
     
  12. MrFox

    MrFox Deludedly Fantastic
    Legend Veteran

    Joined:
    Jan 7, 2012
    Messages:
    5,446
    Likes Received:
    3,945
    Oculus will probably add reprojection too before launch. It's applicable to any VR and it helps with the most sensitive aspect, which is the head rotation.
     
    Shifty Geezer likes this.
  13. upnorthsox

    Veteran

    Joined:
    May 7, 2008
    Messages:
    1,909
    Likes Received:
    232
    Your display has to refresh at that rate though. You can't reproject at 180 fps when your display only does 90 fps.
     
  14. Daozang

    Regular

    Joined:
    Aug 6, 2007
    Messages:
    894
    Likes Received:
    140
    Location:
    Athens
    If it is better to interpolate between no frames and correct frames than having any bad or incorrect data, isn't there a chance that the brain could perceive the interpolated frames as wrong? Are those frames close enough to what the user should see? If that is the case, then Sony has some pretty impressive tech there.

    Yeah, that is true. Some have the Rift dev kits though, and most said that the differences are minimal.
     
  15. turkey

    Regular Newcomer

    Joined:
    Oct 21, 2014
    Messages:
    739
    Likes Received:
    429
    I think Sony where making the point that even if your game runs at the native panel speed it can help.

    I read it that the frame takes x time to create and it uses the best headset position at the start which itself has some lag, by the end of that frame the headset might have a better position so you tweak the frame for position as the very last thing to try and reduce the delay that all the sensors and frame generation have introduced.

    You will always have the motion sensor delay but might be able to shave most off the frame creation so you are working more akin to parallel than serial.
     
  16. MrFox

    MrFox Deludedly Fantastic
    Legend Veteran

    Joined:
    Jan 7, 2012
    Messages:
    5,446
    Likes Received:
    3,945
    The way Richard Marks explained it is that the reprojection is asynchronous. It's not "interpolating" between frames, it's making the game engine run at a different rate than the display, and reduces latency to the minimum possible. All frames being displayed are reprojected. So even if it renders at 90fps or 120fps, it's still an advantage to reproject all frames.

    The motion data of the rendered frame is already old once it's finished rendering and ready to display. So reprojecting a 120fps game at 120fps is cutting latency in half.
     
  17. MrFox

    MrFox Deludedly Fantastic
    Legend Veteran

    Joined:
    Jan 7, 2012
    Messages:
    5,446
    Likes Received:
    3,945
    It's going to be weird that a game targeting 60fps will be in reality oscillating between something like 40fps and 80fps across all gameplay... but the display will remain low latency at 120fps versus the motion data. So the frame rate drops in the game will be seen completely differently than what we're used to, instead of becoming choppy it would create weird artifacts?
     
  18. eastmen

    Legend Subscriber

    Joined:
    Mar 17, 2008
    Messages:
    9,983
    Likes Received:
    1,496
    Yea but you've been able to purchase a dk2 since last summer vs Morpheus that was first shown off in Feb of this year and wont be out till next quarter 1.

    I'd wait until they are all out on the market and see what the short comings and pros of each unit is.
     
    Daozang likes this.
  19. MrFox

    MrFox Deludedly Fantastic
    Legend Veteran

    Joined:
    Jan 7, 2012
    Messages:
    5,446
    Likes Received:
    3,945
    We are speculating based on first hand reports, known engineering limitations, reseach about the basic requirements for a good VR experience, and plenty of presentations about the technology involved. There will be differences and tweaks before release, but the latest prototypes from each company won't have a complete redesign since it's all a year or less from launch.

    People who tried all three VR prototypes within the same day took extensive notes about their observation. So far the PS4 solution is said to feel competitive with high-end PCs from competitors. For that alone it's undeniable that Sony got something impressive far beyond expectations.
     
    orangpelupa and Prophecy2k like this.
  20. DieH@rd

    Legend Veteran

    Joined:
    Sep 20, 2006
    Messages:
    6,122
    Likes Received:
    2,050
    New PC demo of Eve Valkyrie


    On the upcoming Eve Fanfest, CCP will held and stream VR tournament with 8 teams, each with 5 players.
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...