Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Azure Confidential VMs with NVIDIA H100 GPUs for secure retrieval-augmented generation

Microsoft Azure
341K subscribers
<__slot-el>
<__slot-el>
3.1K views 1 year ago #microsoftazure #microsoft
Watch Azure CTO and Technical Fellow Mark Russinovich discuss the benefits of confidential AI and give a demonstration of Azure confidential VMs with NVIDIA H100 Tensor Core GPUs for protecting retrieval-augmented generation (RAG). These VMs let you run your most sensitive GPU enhanced machine learning (ML) workloads on Azure in a hardware based and attested trusted execution environment which helps protect data in memory from unauthorized access, even by Azure operators. These VMs can help protect three types of sensitive data while in use: the ML model itself, pre-training data, and user prompts and responses. To learn more, read the blog: https://aka.ms/CVM-H100-preview. #microsoft #microsoftazure ...more
...more
Comments are turned off. Learn more
Azure Confidential VMs with NVIDIA H100 GPUs for secure retrieval-augmented generation
65Likes
3,157Views
2024Mar 12
Watch Azure CTO and Technical Fellow Mark Russinovich discuss the benefits of confidential AI and give a demonstration of Azure confidential VMs with NVIDIA H100 Tensor Core GPUs for protecting retrieval-augmented generation (RAG). These VMs let you run your most sensitive GPU enhanced machine learning (ML) workloads on Azure in a hardware based and attested trusted execution environment which helps protect data in memory from unauthorized access, even by Azure operators. These VMs can help protect three types of sensitive data while in use: the ML model itself, pre-training data, and user prompts and responses. To learn more, read the blog: https://aka.ms/CVM-H100-preview. #microsoft #microsoftazure

Follow along using the transcript.

Microsoft Azure

341K subscribers