Using Photographs to Enhance Videos of a Static Scene

Discussion in 'Rendering Technology and APIs' started by Bouncing Zabaglione Bros., Oct 12, 2008.

  1. Bouncing Zabaglione Bros.

    Legend

    Joined:
    Jun 24, 2003
    Messages:
    6,363
    Likes Received:
    82
    Interesting new tech developed at Washington Uni, basically using high res still to enhance or edit video scenes. Watch the flash movie.

    [​IMG]
     
  2. fellix

    fellix Hey, You!
    Veteran

    Joined:
    Dec 4, 2004
    Messages:
    3,494
    Likes Received:
    405
    Location:
    Varna, Bulgaria
    So, in a nutshell, this is a technique where the video stream provides the depth info to the hi-res stills or applied post-effects?
    But nonetheless, it's impressive to see it in action. ;)
     
  3. Bouncing Zabaglione Bros.

    Legend

    Joined:
    Jun 24, 2003
    Messages:
    6,363
    Likes Received:
    82
    Well I'm not sure, because there isn't really any depth info in a video, so they must somehow model the scene. They did talk a little about wrapping the photos into 3D space. The highres stills (and it's amazing they only use a few) are kind of used like a high-res mip map for selected parts of the video. The superfusion blending across the temporal stuff was impressive. I really liked the bit at the end where they removed the lamp post and sign from the flower stand - totally seamless.

    We've reached that point where you can't believe anything you can see on screen, because that editing of a scene from a couple of photos and a couple of frame changes was incredible.

    Even the the other applications (relighting the dark table scene, HDR'ing the library window, steady camming the shot of the guy on the roof) were pretty incredible. If this sort of thing can be put into the postprocessor of a video camera it would bring a huge advance in IQ and editing ability. Heck, even available for a modern PC would be great for home post production and editing work - it would be a great showcase for a GPU's processing power.
     
  4. fellix

    fellix Hey, You!
    Veteran

    Joined:
    Dec 4, 2004
    Messages:
    3,494
    Likes Received:
    405
    Location:
    Varna, Bulgaria
    There isn't in fact, but the temporal nature of the video stream could be used to construct an accurate enough scene depth info, where the magic is.

    Now, there's a real incentive for all those CCTVs to get larger sensors. :D
     
  5. Davros

    Legend

    Joined:
    Jun 7, 2004
    Messages:
    15,361
    Likes Received:
    2,551
    looks to me like they are using photos as textures in video
     
  6. Sxotty

    Veteran

    Joined:
    Dec 11, 2002
    Messages:
    4,988
    Likes Received:
    378
    Location:
    PA USA
    That was incredibly cool IMO. Thanks for posting it BZB
     
  7. Davros

    Legend

    Joined:
    Jun 7, 2004
    Messages:
    15,361
    Likes Received:
    2,551
    is the texture replacement automatic or does the user have to match u the video with the photo
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...