Sign in to confirm you’re not a bot
This helps protect our community. Learn more

MR Speaker Series: The Making of SonzaiXR

Microsoft Developer
588K subscribers
<__slot-el>
<__slot-el>
461 views 3 years ago
Get a glimpse into the technology behind building a HoloLens2 immersive, sensory experience exhibited at the Victoria & Albert Museum, London. Including Volumetric Capture, Unreal Engine, Mixed Reality Toolkit, Azure Speech Studio, and how these pieces fit together to create an experience designed to be shown to hundreds of users in a gallery housing Constable and Turner paintings. Check out the teaser video at https://aka.ms/sonzai or the project page at the V&A museum V&A · Sonzai (vam.ac.uk) Volumetric Capture by https://www.dimensionstudio.co/ Volumetric technology by Microsoft Mixed Reality Capture Studios http://aka.ms/mrcs You can follow Pete's ongoings at his blog at https://peted.azurewebsites.net/ Connect with Pete on LinkedIn   / peterdaukintis   or follow him on twitter at   / peted70  . Pete Daukintis, Sr. Software Engineer, Microsoft. For more information about Pete, please visit https://peted.azurewebsites.net/about/ ...more
...more

Inspiration

3:55

Volumetric Capture of the Dance

6:12

Levels

11:20

Spatial Anchors

12:00

Hand Tracking

14:54

Sequencer

17:06

Unreal Engine

17:43

Editor Preview

18:02

Vfx

18:25

The World Outliner

18:48

Sequencer User Interface

19:08

Timeline

19:53

Soundscape

22:30

Spatial Audio

23:28

Hololens 2 Display Technology

23:54

Unreal Insights

26:12

Floating Text with the Voiceover

27:35

Speech Studio

28:14

Reusable Component

29:09

Mixed Reality Toolkit

30:22

User Interface

30:45

Design of the Floor

32:33

Developer Mode

36:01

Kiosk Mode

36:14

Did You Stream the Scene in Unreal from Azure Cloud to Hololens 2 and if So What Tool Webrtc Azure Mesh

38:09
MR Speaker Series: The Making of SonzaiXR
6Likes
461Views
2022Jan 20
Get a glimpse into the technology behind building a HoloLens2 immersive, sensory experience exhibited at the Victoria & Albert Museum, London. Including Volumetric Capture, Unreal Engine, Mixed Reality Toolkit, Azure Speech Studio, and how these pieces fit together to create an experience designed to be shown to hundreds of users in a gallery housing Constable and Turner paintings. Check out the teaser video at https://aka.ms/sonzai or the project page at the V&A museum V&A · Sonzai (vam.ac.uk) Volumetric Capture by https://www.dimensionstudio.co/ Volumetric technology by Microsoft Mixed Reality Capture Studios http://aka.ms/mrcs You can follow Pete's ongoings at his blog at https://peted.azurewebsites.net/ Connect with Pete on LinkedIn   / peterdaukintis   or follow him on twitter at   / peted70  . Pete Daukintis, Sr. Software Engineer, Microsoft. For more information about Pete, please visit https://peted.azurewebsites.net/about/

Follow along using the transcript.

Microsoft Developer

588K subscribers