Kinect technology thread

Discussion in 'Console Technology' started by LightHeaven, Feb 5, 2010.

  1. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    I think what the dev was talking about is the fact that Kinect has a 640x480 depth camera but on the 360 they can only use it at 360x240 @ 30FPS

    unless they are talking about the 1600x1200 Color image size used for taking pictures but I'm not even sure if thats used in the Kinect design.
     
  2. joker454

    Veteran

    Joined:
    Dec 28, 2006
    Messages:
    3,819
    Likes Received:
    139
    Location:
    So. Cal.
    Hmm, the article says the usb 2.0 connection is the limiting factor with this line:

    "But they can't give the full resolution picture, at the full frame-rate, because of the USB 2.0 connection. It's just the technicalities of the Xbox. "

    ...which would imply that usb 2.0 would limit the pc as well. So does that mean Kinect is a usb 3.0 device and that's how hackers are using it at full bandwidth? Or that the 360's usb implementation is not full 2.0 spec?
     
  3. Arwin

    Arwin Now Officially a Top 10 Poster
    Moderator Legend

    Joined:
    May 17, 2006
    Messages:
    18,762
    Likes Received:
    2,639
    Location:
    Maastricht, The Netherlands
    The suggestion in the article is very clearly that the USB 2.0 is using a bus that it needs to share with other devices, and to make sure all devices get an expected throughput, the designers have allotted each device (or device group) a portion of the available bandwidth that leaves the USB 2.0 connection with less than its expected max throughput.

    I think what is also being suggested is that Kinect won't be able to do 640x480 video in combination with the depth sensor, something I previously didn't expect to be possible because of lag (but that's wrong in the sense that you can easily delay the feed to match the input if necessary), but now perhaps it's held back by this. Else I would have expected to see it very early on, and not just some screenshots as we're seeing all the time now.
     
  4. Scott_Arm

    Legend

    Joined:
    Jun 16, 2004
    Messages:
    15,134
    Likes Received:
    7,680
    I think the 360 USB 2.0 ports are not full spec.
     
  5. joker454

    Veteran

    Joined:
    Dec 28, 2006
    Messages:
    3,819
    Likes Received:
    139
    Location:
    So. Cal.
    Ah yeah my bad, was eating a sandwich so I had just skimmed the article quick. Well that explains that. At least the good news is that the same camera will get insta-upgraded on the next gen machines which is cool.
     
  6. scently

    Veteran

    Joined:
    Jun 12, 2008
    Messages:
    1,145
    Likes Received:
    563
    Joker have you had a go at Kinect? What are your impression of the device.
     
  7. (((interference)))

    Veteran

    Joined:
    Sep 10, 2009
    Messages:
    2,499
    Likes Received:
    70
    Oh, so they did go with the original res depth cam after all - i'm satisfied that I was wrong about the downgrade to QVGA.

    And wouldn't it be possible to use the full depth cam res, despite the USB 2.0 limitation?
    Say Kinect transmits a 320x240 colour feed and 640x480 depth feed, instead of the opposite which it currently uses?

    Can the guys working on Kinect homebrew use the full bandwith since their PCs support USB 2.0 or can Kinect only output at USB 2.0 spec?
     
  8. joker454

    Veteran

    Joined:
    Dec 28, 2006
    Messages:
    3,819
    Likes Received:
    139
    Location:
    So. Cal.
    Nopers, never tried it. I actually don't have much interest personally in motion controls, although my wife has mentioned wanting one so I probably get it eventually. Amusingly though, I can probably use Kinect for my new business so I could tax deduct it :)
     
  9. Colourless

    Colourless Monochrome wench
    Veteran

    Joined:
    Feb 6, 2002
    Messages:
    1,274
    Likes Received:
    30
    Location:
    Somewhere in outback South Australia
    The depth camera might be 640x480 but the processing of the IR image by the onboard processor might use 4 pixels to calculate the depth.
     
  10. thop

    thop Great Member
    Veteran

    Joined:
    Feb 23, 2003
    Messages:
    1,286
    Likes Received:
    0
    http://www.youtube.com/watch?gl=DE&v=KWbLOFGSEDo

    You are the controller? It seems not! :D

    I wonder if many games, especially racing games, will have some sort of default path, over which actual data is then 'overlayed' to filter out unexpected moves.
     
  11. egoless

    Regular

    Joined:
    Jul 12, 2005
    Messages:
    335
    Likes Received:
    40
    Delete
     
    #831 egoless, Nov 23, 2010
    Last edited by a moderator: Oct 4, 2014
  12. BadTB25

    Veteran

    Joined:
    Aug 11, 2007
    Messages:
    2,371
    Likes Received:
    645
    Location:
    Florida
    Too many vids to list at once, but there are some really interesting homebrew applications here: http://kinecthacks.net/

    Also, I find it curious that Your Shape has almost zero lag, but appears to be using the skeletal tracking and depth sensor data.. I wonder what they are doing different that enables such a difference and can we expect a lessening of noticeable lag in future titles.

    So far, for me, only Kinect Adventures really stand out with a little bit noticeable in Table Tennis for Kinect Sports.
     
  13. BadTB25

    Veteran

    Joined:
    Aug 11, 2007
    Messages:
    2,371
    Likes Received:
    645
    Location:
    Florida
    I would be really curious on what you have to say on the technology if you ever got a hold of one.
     
  14. L. Scofield

    Veteran

    Joined:
    Mar 28, 2007
    Messages:
    2,559
    Likes Received:
    323
    I like this one>

     
  15. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    44,106
    Likes Received:
    16,898
    Location:
    Under my bridge
    The tech is all starting to get a little confused now! According to Prime Sense, the depth data is quarter the res of the CCD data, but the PC shows this isn't the case. Or the camera is ~1280x960 in res. Then there is the fact the PC is getting full res feeds when 360 doesn't, there must be a communication protocol to say to the hardware "I just want a lowres feed" and the Kinect device is downscaling for the lower-bandwidth port.

    The biggest question has to be why MS didn't release an XNA kit? There'd have plenty more exploring ideas with the full skeleton tracking to boot.
     
  16. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    because Your Shape is more like the EyeToy games & use your image on screen instead of using the Kinect tracking points to control a on screen avatar.

    the avatar's controls are made up of a lot of preset gestures & kinect use the tracking points to match your movements up with these preset gestures that they have in their database & it has to guess at your movements every frame & recreate that on screen.

    that's what I remember from the patent & a few articles I read.

    with Your Shape they don't have to recreate your movements because it's you on the screen.
     
  17. Arwin

    Arwin Now Officially a Top 10 Poster
    Moderator Legend

    Joined:
    May 17, 2006
    Messages:
    18,762
    Likes Received:
    2,639
    Location:
    Maastricht, The Netherlands
    That doesn't sound quite right. Your Shape simply does its own interpretation of the 3D feed directly. As there are very fixed scenarios to which it needs to match your movements, it is much more efficient to do it like that. And particularly with stuff like Tai Chi the movements are very slow, so you can go for a great deal of accuracy too, and you're not limited to the 22 joints that the avatar stuff gives you.

    Basically everything that has you, the player, match an example on screen (which includes Dance Central) it is very likely to be easier, but more importantly, faster to do so by directly taking the 3D feed.
     
  18. dragonelite

    Veteran

    Joined:
    Dec 20, 2009
    Messages:
    1,556
    Likes Received:
    1
    Location:
    netherlands
    Didn't turn 10 also made their own way to process kinect data instead of using the standard way..
    Because they had sitting down and squatting already in game with forza kinect demo.
     
  19. LightHeaven

    Regular

    Joined:
    Jul 29, 2005
    Messages:
    539
    Likes Received:
    20
    Its not just image, they definitely track your joints and position in a 3d space.

    Ie: There are workouts you have to punch and kick green boxes. The game can tell if you used the correct arm/leg and if you reached far enough to hit them.
     
  20. onQ

    onQ
    Veteran

    Joined:
    Mar 4, 2010
    Messages:
    1,540
    Likes Received:
    56
    what doesn't sound quite right? you said pretty much the same thing I said we just went different ways about saying it.

    Your Shape use the video from the 3D depth camera much like the EyeToy games used the video from the Eyetoy but with the depth cam you get on the fly background removal so it's just your image on the screen & you have depth information .
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...