PlayStation 4 Camera driver released ( PS4EYECam )

Discussion in 'Console Industry' started by onQ, Sep 22, 2014.

  1. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56

    http://playstationhax.it/released-ps4eyecam-a-ps4-camera-driver/
     
    #1 onQ, Sep 22, 2014
  2. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    43,576
    Likes Received:
    16,033
    Location:
    Under my bridge
    Followed the link to his Twitter feed. Suggests the Depth Stream is indeed a depth buffer coming from the camera. That'd suggest on-board processing of stereo image for depth.
     
    #2 Shifty Geezer, Sep 22, 2014
  3. DieH@rd

    DieH@rd
    Legend Veteran

    Joined:
    Sep 20, 2006
    Messages:
    6,281
    Likes Received:
    2,265
    It is shame that PS4 camera does not have standard USB port.
     
    #3 DieH@rd, Sep 22, 2014
  4. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    Yeah it has a bridge processor OV00580 from OmniVision that I haven't been able to find much info on connecting the 2 cameras ( OV9713 or OV9714 ? )

    Chipworks has die shoots of the bridge processor for sale for $2,500 & I seen a supplier selling the chips for $5 I think. That's all the information I have seen on the image processor.

    [​IMG]

    https://chipworks.secure.force.com/...artID=e14444e7-5a06-4f26-9217-326f5ff83d0c&g=


    There is a 3D scanning tablet using the OV9714 camera which is close to or the same sensor that's in the PS4 camera but it's being used with a IR projector.

    [​IMG]

    [​IMG]


    http://www.tomsguide.com/us/mv4d-3d-scanning-tablet-avatars,news-19562.html
    http://www.greenbot.com/article/268...googles-project-tango-tech-to-the-masses.html

    There is a howto guide on how to convert the cable to USB 3.
     
    #4 onQ, Sep 22, 2014
    Last edited by a moderator: Sep 22, 2014
    Pete likes this.
  5. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    43,576
    Likes Received:
    16,033
    Location:
    Under my bridge
    Yep. Just like Kinect 1.
     
    #5 Shifty Geezer, Sep 22, 2014
  6. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    But that's with the tablet using one camera and a IR projector. PS4 is using stereo vision without the IR projector. Unless the red LED is somehow a Near IR projector (which is something I been wondering for a while)
     
    #6 onQ, Sep 22, 2014
  7. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    Look like the bridge image processor OV580 is also the bridge image processor in the new Leapmotion sensor but leapmotion is using 2 OV7251 cameras.




    http://www.mitgai.net/2014/05/human-computer-interaction/leap-motion-camera.html#more-352
     
    #7 onQ, Sep 22, 2014
  8. Grall

    Grall Invisible Member
    Legend

    Joined:
    Apr 14, 2002
    Messages:
    10,801
    Likes Received:
    2,175
    Location:
    La-la land
    The red LED is just a red LED... It's far too weak to project anything these tiny consumer cameras can pick up (you'd probably need something on the sensitivity level of a supercooled FLIR to pick up the illumination of tha tiny front LED...) It doesn't project a dot pattern either, so it doesn't really matter that it's really weak. :)
     
    #8 Grall, Sep 22, 2014
  9. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    If it's Near IR you wouldn't be able to see it with your eyes so it could be sending out pulses of IR to be reflected back to the camera to give depth information. It doesn't have to be structured light. But I don't think that's the case I think it's just stereo vision that's using the lighting from your room & sometimes the lighting from your TV.


    I wonder if we will see any games using the 3D scanning to insert your real objects in the game or even let you scan your room into the game.


    NBA 2K will have face scanning.



     
    #9 onQ, Sep 23, 2014
    Last edited by a moderator: Sep 23, 2014
  10. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    43,576
    Likes Received:
    16,033
    Location:
    Under my bridge
    How? How can intermittently filling a scene with flat, front-on illumination provide any depth data?
     
    #10 Shifty Geezer, Sep 23, 2014
  11. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    By measuring the the time that it take for the light to hit the object.


    Also the 2 cameras can be set to different exposures or something so there will be a difference in illumination from the pulse between the 2 cameras giving you depth.
     
    #11 onQ, Sep 23, 2014
    Last edited by a moderator: Sep 23, 2014
  12. Rurouni

    Rurouni
    Veteran

    Joined:
    Sep 30, 2008
    Messages:
    1,071
    Likes Received:
    399
    You're basically describing a TOF camera, which I'm pretty sure the PS Eye isn't. It needs specialized sensor and electronics.
     
    #12 Rurouni, Sep 23, 2014
  13. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    43,576
    Likes Received:
    16,033
    Location:
    Under my bridge
    That's been covered before. You need a specific TOF sensor to do that, like Kinect 2. It's not possible for PS4's camera to use a pulsed light for measuring depth. If it was a feature, Sony would have mentioned it (and sourced a TOF sensor from somewhere).

    I'm not trusting the camera to output a depth buffer. Computer vision is a demanding process. Here's what Google's using : http://techcrunch.com/2014/02/20/in...-at-the-heart-of-googles-project-tango-phone/

    and https://www.youtube.com/watch?v=vsQJ4qkCl1k

    Claims 1 TF of processing power in the article. I doubt PS4's camera has anything like that, and the 'depth buffer' will be a preprocessed image saving some work for the system to do, but it'll still have to do a lot with it to get a sense of 3D vision.

    Edit: the Google/Movidius solutions are for single-lens depth detection, so I guess with stereo images it could be a lot less demanding, but I still doubt we get a full depth buffer out the camera. Hopefully it won't be too long before that's (dis)proven!
     
    #13 Shifty Geezer, Sep 23, 2014
  14. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    That's already established. I said I already know that it's using stereo vision I was just explaining how the beam of IR could be used if it was there.


    I was still talking about using the 2 cameras for triangulation but having the cameras at different exposures so that the image from the right & left cameras would show a difference from the time that it take to illuminate them with the pulse of light.
     
    #14 onQ, Sep 23, 2014
  15. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    Sony has a patent using pretty much the same tech as the Mantis Vision tablet & Project Tango for a Playstation Move /Pen like controller.Seems that a normal IR camera & IR projector might be the way to go for small low power 3D scanning / tracking.

     
    #15 onQ, Sep 24, 2014
    Last edited by a moderator: Sep 24, 2014
  16. Grall

    Grall Invisible Member
    Legend

    Joined:
    Apr 14, 2002
    Messages:
    10,801
    Likes Received:
    2,175
    Location:
    La-la land
    It's a red LED (which we can visually identify as emitting the color red), so it's obviously not a near IR LED. Also, it's far, far, FAR too weak to be a pulsed IR LED for a depth sensor. Look at the huge enormous LEDs in the kinect2, they're so powerful they actually need active cooling.

    Without really powerful output you can't gather enough light to create any meaningful structure on the input side. Remember the inverse square law? As weak as the output of that LED is (a few mWs of CONTINUOUS power at most, much less pulsed), far less would return to a sensor after spreading out in the room, some of it scattering or partially absorbing into foreground objects, and then reflecting back to a sensor.

    So your wild theory is clearly unworkable. It's pretty well known and established the PS4 eye is just two standard webcams slung together in one plastic shell (with an array mic thrown in for good measure.)
     
    #16 Grall, Sep 24, 2014
  17. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    Just because you see red coming from the LED doesn't mean it's not Near IR because the LED could be a 770 nm NIR LED giving off a weak red signal. Just because Kinect has a big LED array that needs to be cooled off doesn't mean that every IR sensor needs that just to sense depth you should know that just from the Mantis Vision IR projector that's being used in Project Tango & the MV4D tablet. the sensor in the MV4D tablet is pretty much the same as what is suspected to be in the PS4 camera the specs of ov9713 & ov9714 are pretty much the same.

    (Mantis Vision IR projector)
    [​IMG]


    I already know that the PS4 camera is using stereo vision. but sometimes things are more than they appear to be.

    By the way here is what I believe to be the patent for the PlayStation 4 camera depth processing

    Image processing apparatus and image processing method

    [​IMG]

    [​IMG]
     
    #17 onQ, Sep 24, 2014
    Last edited by a moderator: Sep 24, 2014
(You must log in or sign up to post here.)
Loading...
Similar Threads - PlayStation Camera driver
  1. snc

    Sony PlayStation VR 2 (PSVR2)

    snc, Feb 23, 2021 at 2:21 PM, in forum: VR and AR
    Replies:
    36
    Views:
    590
    Karamazov
    Feb 25, 2021 at 10:08 AM
  2. corysama

    Handing out free advice for everyone making their own PlayStation 2 game engines

    corysama, Nov 13, 2020, in forum: Console Technology
    Replies:
    2
    Views:
    927
    corysama
    Nov 16, 2020
  3. Shortbread

    Sony Playstation Gaming Showcase [2020-09-16]

    Shortbread, Sep 15, 2020, in forum: Console Industry
    Replies:
    308
    Views:
    9,582
    BRiT
    Sep 24, 2020
  4. stranno

    Is there any reason to design a Playstation game like this?

    stranno, Sep 9, 2020, in forum: Console Technology
    Replies:
    3
    Views:
    1,080
    milk
    Nov 3, 2020
  5. BRiT

    Serious Sam 4: [PC, Stadia, XBox, Playstation]

    BRiT, Aug 28, 2020, in forum: Console Gaming
    Replies:
    7
    Views:
    770
    BRiT
    Sep 15, 2020
  6. Lucid_Dreamer

    PlayStation Camera: What are the benefits?

    Lucid_Dreamer, Nov 7, 2013, in forum: Console Technology
    Replies:
    206
    Views:
    23,914
    onQ
    Feb 7, 2015

Share This Page

Toggle Width
Style
Beyond3D

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.

  • Quick Navigation

Loading...