Machine Learning: WinML/DirectML, CoreML & all things ML

Discussion in 'Rendering Technology and APIs' started by Ike Turner, Mar 5, 2019.

  1. Ike Turner

    Ike Turner
    Veteran Regular

    Joined:
    Jul 30, 2005
    Messages:
    1,884
    Likes Received:
    1,759
    Since the first big commercial use case of WinML is now publicly available (in Adobe Lightroom CC 0219) I thought that it would be better to have dedicated thread about all Machine Learning things instead of polluting the Nvidia DLSS thread with semi OT content.

    Anyway, here are the goodies:

    Adobe Lightroom CC 0219 Image Enhancer using WinML & CoreML:

    https://theblog.adobe.com/enhance-details/

    Performance (spoiler AMD's GCN is fast):

    https://www.pugetsystems.com/labs/a...C-2019-Enhanced-Details-GPU-Performance-1366/
    [​IMG]

    In other ML news..Unity developed its own ML inference engine which is totally cross platform/HW compatible! No need for TensorFlow/WinML,CoreML or any other IE.. "it just works" on anything:

    Unity ML-Agents Toolkit:
    https://blogs.unity3d.com/2019/03/0...v0-7-a-leap-towards-cross-platform-inference/
     
    #1 Ike Turner, Mar 5, 2019
    AlBran, Per Lindstrom, Lightman and 3 others like this.
  2. Max McMullen

    Max McMullen
    Newcomer

    Joined:
    Apr 4, 2014
    Messages:
    20
    Likes Received:
    104
    Location:
    Seattle, WA
    Unity's done a great job integrating ML into their product so far and it makes sense for them to have a layer that can provide ML functionality without any platform specific frameworks. That said, the DirectX platform does have some unique hardware acceleration support in DirectML. At this year's GDC we announced the public release of the DirectML API and Unity announced support for DirectML, leveraging it where they can for increased performance:

    https://devblogs.microsoft.com/directx/gaming-with-windows-ml/
    https://devblogs.microsoft.com/directx/directml-at-gdc-2019/

    Thanks,
    Max McMullen
    Development Manager
    Compute, Graphics, & AI
    Microsoft
     
    #2 Max McMullen, Mar 22, 2019
    Shifty Geezer, Lightman, Silent_Buddha and 9 others like this.
  3. Ike Turner

    Ike Turner
    Veteran Regular

    Joined:
    Jul 30, 2005
    Messages:
    1,884
    Likes Received:
    1,759
    ESRGAN image upscaler (Enhanced Super-Resolution Generative Adversarial Networks) is finally free from its CUDA "shackles".
    It has been ported to Unity's cross platform Inference Engine (named Barracuda :cool:) and now works on Intel/AMD/Nvidia hardware directly inside Unity.
    Download Unity package here (& import into Unity 2018.3+ ).
     
    #3 Ike Turner, May 10, 2019
    Last edited: May 10, 2019
    milk, Silent_Buddha, AlBran and 3 others like this.
  4. iroboto

    iroboto Daft Funk
    Legend Regular Subscriber

    Joined:
    Mar 6, 2014
    Messages:
    7,905
    Likes Received:
    6,187
    nice! Unity is getting pretty awesome. What a fantastic feature for developers.
     
    #4 iroboto, May 10, 2019
  5. AlBran

    AlBran Ferro-Fibrous
    Moderator Legend

    Joined:
    Feb 29, 2004
    Messages:
    20,726
    Likes Received:
    5,819
    Location:
    ಠ_ಠ
    Is it too much to ask for some freeware where I can just input a batch of images/textures/etc., select a SuperScale amount, and presto-output-folder? :p

    Kind of curious to see if MS can have that as an option when taking screenshots on Xbox or Win10, for example. It'd be like having Ansel (so hot right now) without needing to inject it or have developer intervention (only select games).

    I'd love to see an experiment for 90s 2D/sprite games. Is performance there for real-time superscaling where older-school games are in the 320x200-800x600 range :?: I guess they'd have to be on D3D first... and maybe there'd be crazy artefacting in motion around moving objects (e.g. isometric games). :s zoidblerg.
     
    #5 AlBran, May 11, 2019
    Last edited: May 11, 2019
  6. iroboto

    iroboto Daft Funk
    Legend Regular Subscriber

    Joined:
    Mar 6, 2014
    Messages:
    7,905
    Likes Received:
    6,187
    not quite just a freeware with some customizations ;)
    I suspect someone can make the tool like that. what are you looking to do?
     
    #6 iroboto, May 11, 2019
  7. zed

    zed
    Veteran

    Joined:
    Dec 16, 2005
    Messages:
    4,443
    Likes Received:
    631
    well considering it took over a minute on a single 256x256 sized texture on my admittedly inboard graphics I say having this running at good framerates is a long way off.
    Also it doesnt handle Jpg artifacts well, just makes them worse, so prolly not the best for photos, but old CGI yes could be good
     
    #7 zed, May 13, 2019
  8. milk

    milk
    Veteran Regular

    Joined:
    Jun 6, 2012
    Messages:
    2,995
    Likes Received:
    2,563
    I think a more workable way of doing this would be to rip the game's source art, superscale that up, and inject the higher res art into the game. Some emulators allow such fan-made texture-patch injection.
     
    #8 milk, May 13, 2019
  9. Per Lindstrom

    Per Lindstrom
    Newcomer Subscriber

    Joined:
    Oct 16, 2018
    Messages:
    23
    Likes Received:
    18
    Very quiet about DirectML, any news?
     
    #9 Per Lindstrom, Oct 15, 2019 at 4:53 PM
  10. iroboto

    iroboto Daft Funk
    Legend Regular Subscriber

    Joined:
    Mar 6, 2014
    Messages:
    7,905
    Likes Received:
    6,187
    its released. It's up to developers to take advantage of it.
     
    #10 iroboto, Oct 15, 2019 at 5:39 PM
    Per Lindstrom likes this.
  11. Per Lindstrom

    Per Lindstrom
    Newcomer Subscriber

    Joined:
    Oct 16, 2018
    Messages:
    23
    Likes Received:
    18
    [​IMG]
    Found out yesterday. :).
     
    #11 Per Lindstrom, Oct 16, 2019 at 5:27 PM
    orangpelupa and iroboto like this.
(You must log in or sign up to post here.)
Loading...
Similar Threads - Machine Learning WinML
  1. sparsh

    Survey on Deep Learning on NVIDIA's Jetson Platform

    sparsh, Jan 23, 2019, in forum: Mobile Devices and SoCs
    Replies:
    0
    Views:
    701
    sparsh
    Jan 23, 2019
  2. sparsh

    Survey on FPGA-based Accelerators for CNNs

    sparsh, Sep 29, 2018, in forum: Graphics and Semiconductor Industry
    Replies:
    0
    Views:
    2,166
    sparsh
    Sep 29, 2018
  3. Shifty Geezer

    Should Cloud AI players be created to beef up multiplayer games?

    Shifty Geezer, May 15, 2018, in forum: Console Industry
    Replies:
    17
    Views:
    974
    Shifty Geezer
    May 17, 2018
  4. RoOoBo

    Looking for 3D graphic driver developers, Machine Learning and RTL designers in Barcelona

    RoOoBo, Mar 19, 2018, in forum: Industry Jobs
    Replies:
    0
    Views:
    1,968
    RoOoBo
    Mar 19, 2018
  5. Alucardx23

    Machine Learning to enhance game image quality

    Alucardx23, Mar 23, 2017, in forum: Console Technology
    Replies:
    27
    Views:
    6,397
    Alucardx23
    May 29, 2018
  6. Commenter

    The rise of steam machines

    Commenter, Aug 25, 2014, in forum: Console Technology
    Replies:
    7
    Views:
    1,578
    orangpelupa
    Aug 25, 2014

Share This Page

Toggle Width
Style
Beyond3D

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.

  • Quick Navigation

Loading...