Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Introduction to Deep Learning Models in Unreal

Microsoft Developer
588K subscribers
<__slot-el>
<__slot-el>
18K views 2 years ago
In this session we will explore different ways deep learning neural network models can and will be used in gaming. We will dive into different use cases and show how to leverage existing open-source model zoos. Then we will demo how to apply a PyTorch Style Transfer Model that does real time inferencing frame by frame. We will learn about the new experimental plugins, Neural Network Inference (NNI) that is powered by ONNX Runtime and OpenCV Helper that were released with Unreal Engine 5. Join the Mixed Reality Developer Program to get the latest on our developer tools, events, and early access offers: https://aka.ms/IWantMR    / onnxruntime   https://onnxruntime.ai/docs/   / onnxruntime     / 77691267   https://github.com/microsoft/OnnxRunt... Participate in the Mixed Reality Dev Days Online Hackathon now through July 8, 2022. Register to join at https://aka.ms/DevDaysHack ...more
...more

Introduction to Deep Learning

0:55

Real-Time Style Transfer

2:40

Deep Learning Neural Networks

3:57

Automating Game Logic

4:38

Story Generation

5:16

Speech Recognition

5:54

Code Generation and the Codex Models

6:48

Chess Board

7:26

Ai Dungeon

7:59

Automated Reachability Testing

11:34

Style Transfer Models

13:31

Rain Princess

13:40

Image Classification

17:32

Super Resolution

17:39

Fast Neural Style Transfer

17:51

Create New Models

18:24

Pre-Processing

22:41

Opencv Helper

23:09

Add the Plugins

29:42

Post-Processing

35:16

Post-Processing Materials

35:23
Introduction to Deep Learning Models in Unreal
400Likes
18,172Views
2022Jun 20
In this session we will explore different ways deep learning neural network models can and will be used in gaming. We will dive into different use cases and show how to leverage existing open-source model zoos. Then we will demo how to apply a PyTorch Style Transfer Model that does real time inferencing frame by frame. We will learn about the new experimental plugins, Neural Network Inference (NNI) that is powered by ONNX Runtime and OpenCV Helper that were released with Unreal Engine 5. Join the Mixed Reality Developer Program to get the latest on our developer tools, events, and early access offers: https://aka.ms/IWantMR    / onnxruntime   https://onnxruntime.ai/docs/   / onnxruntime     / 77691267   https://github.com/microsoft/OnnxRunt... Participate in the Mixed Reality Dev Days Online Hackathon now through July 8, 2022. Register to join at https://aka.ms/DevDaysHack

Follow along using the transcript.

Microsoft Developer

588K subscribers