Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Running GPT-3 Models with NVIDIA® NeMo Megatron on Azure

Microsoft Azure
339K subscribers
<__slot-el>
<__slot-el>
4K views 2 years ago #MicrosoftAzure #Microsoft
This is a brief tutorial given by Hugo Affiticati, Technical Program Manager for the HPC and AI Benchmarking Team at Microsoft Azure, about how you can run GPT-3 model on Azure using NVIDIA NeMo Megatron. This benchmark test tutorial uses the Azure NDm A100 v4 virtual machine, featuring eight (8) NVIDIA A100 80GB GPUs and 400GB/s InfiniBand networking interconnects. The Azure CycleCloud tutorial video (also available on YouTube) is also handy for context on this video. For complete information and performance details, please go to https://aka.ms/AI/NeMo #Microsoft #MicrosoftAzure ...more
...more
Comments are turned off. Learn more
Running GPT-3 Models with NVIDIA® NeMo Megatron on Azure
62Likes
4,072Views
2023Mar 10
This is a brief tutorial given by Hugo Affiticati, Technical Program Manager for the HPC and AI Benchmarking Team at Microsoft Azure, about how you can run GPT-3 model on Azure using NVIDIA NeMo Megatron. This benchmark test tutorial uses the Azure NDm A100 v4 virtual machine, featuring eight (8) NVIDIA A100 80GB GPUs and 400GB/s InfiniBand networking interconnects. The Azure CycleCloud tutorial video (also available on YouTube) is also handy for context on this video. For complete information and performance details, please go to https://aka.ms/AI/NeMo #Microsoft #MicrosoftAzure

Follow along using the transcript.

Microsoft Azure

339K subscribers