GauGAN - Artist tool uses AI to create photorealistic images from sketches

Discussion in 'Rendering Technology and APIs' started by pharma, Aug 1, 2019.

  1. pharma

    Veteran Regular

    Joined:
    Mar 29, 2004
    Messages:
    2,933
    Likes Received:
    1,628
    New tool (GauGAN) for artists creates photorealistic images from segmentation maps which are labeled sketches that depict the layout of a scene.

    [​IMG]

    Live interactive demo link below.
    https://www.nvidia.com/en-us/research/ai-playground/

    Tool:
    http://nvidia-research-mingyuliu.com/gaugan
     
  2. iroboto

    iroboto Daft Funk
    Legend Regular Subscriber

    Joined:
    Mar 6, 2014
    Messages:
    7,905
    Likes Received:
    6,188
    Beast. I wish I could even begin to contemplate how to approach this. The creativity in this field is amazing
     
  3. orangpelupa

    orangpelupa Elite Bug Hunter
    Legend Veteran

    Joined:
    Oct 14, 2008
    Messages:
    7,165
    Likes Received:
    1,311
    In the future, with final product, combined with VR could be like what this girl did

     
  4. Silent_Buddha

    Legend

    Joined:
    Mar 13, 2007
    Messages:
    16,157
    Likes Received:
    5,095
    Looks like it just comes down to color fill (and perhaps screen position?) determining what type of stock imagery to use to fill in the space and what properties to assign to that space. Also set scenery to use for transitions between color fill areas.

    Still pretty cool to see though.

    Regards,
    SB
     
  5. iroboto

    iroboto Daft Funk
    Legend Regular Subscriber

    Joined:
    Mar 6, 2014
    Messages:
    7,905
    Likes Received:
    6,188
    it's doing a bunch of stuff, but it's starting off with basic premises, color helps determine what it is, but it's really the shape that is a bigger differentiator it appears.
     
  6. pharma

    Veteran Regular

    Joined:
    Mar 29, 2004
    Messages:
    2,933
    Likes Received:
    1,628
    Will be interesting to see how far they can take this. Apparently it has some smarts since it will adjusts the whole landscape lighting depending on time of day, color or materials used in particular areas. Great idea for making your own desktop backgrounds.
     
  7. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    40,741
    Likes Received:
    11,221
    Location:
    Under my bridge
    You tell it what to draw. You select bush, gravel, snow, etc and blob it in.

    Here's Sky, Dirt, River, Mountain, Bush

    Image1.png

    I broke it with Snow and Sand in the same image!

    Image2.png
     
    #7 Shifty Geezer, Aug 10, 2019
    Last edited: Aug 10, 2019
    pharma and iroboto like this.
  8. Shifty Geezer

    Shifty Geezer uber-Troll!
    Moderator Legend

    Joined:
    Dec 7, 2004
    Messages:
    40,741
    Likes Received:
    11,221
    Location:
    Under my bridge
    You can select abstract templates as a reference image and it changes the results to make them abstract. The red hand, black blob image gets interesting results. It seems to be building some form of representation and chopping up a reference image.
     
    #8 Shifty Geezer, Aug 10, 2019
    Last edited: Aug 10, 2019
  9. iroboto

    iroboto Daft Funk
    Legend Regular Subscriber

    Joined:
    Mar 6, 2014
    Messages:
    7,905
    Likes Received:
    6,188
    Okay that makes a lot more sense
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...