Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Azure OpenAI Deployment Types and Resiliency

John Savill's Technical Training
317K subscribers
<__slot-el>
<__slot-el>
7.1K views 5 months ago #Azure #AI #openai
A dive into how Azure OpenAI works, what different deployment types mean for your use and how to think about the high availability of your deployments. 🔎 Looking for content on a particular topic? Search the channel. If I have something it will be there! 🤔 Due to the channel growth and number of people wanting help I no longer can answer or even read questions, and they will just stay in the moderation queue never to be seen so please post questions to other sites like Reddit, Microsoft Community Hub etc. ▬▬▬▬▬▬ C H A P T E R S ⏰ ▬▬▬▬▬▬ 00:00 - Introduction 00:21 - Generative API is stateless 02:21 - Regional Azure OpenAI resource 04:54 - Capacity pools 08:27 - Responsible AI 09:27 - Model deployment types 11:21 - Standard 11:56 - Global 12:17 - Network vs inference latency 14:42 - Intelligent routing 17:47 - Quota vs available capacity 19:30 - Data zone and data residency 22:50 - Availability benefits? 23:52 - Resource is regional 24:31 …...more
...more

Introduction

0:00

Generative API is stateless

0:21

Regional Azure OpenAI resource

2:21

Capacity pools

4:54

Responsible AI

8:27

Model deployment types

9:27

Standard

11:21

Global

11:56

Network vs inference latency

12:17

Intelligent routing

14:42

Quota vs available capacity

17:47

Data zone and data residency

19:30

Availability benefits?

22:50

Resource is regional

23:52

Multiple regional resources

24:31

Enabling in the application

25:53

API Management

26:49

Prompt caching impact

29:08

Provisioned service

31:25

PayGo features

32:15

PTU features

36:26

Azure reservations

43:24

Batch service

45:36

Summary

47:26

Close

49:54
Azure OpenAI Deployment Types and Resiliency
202Likes
7,107Views
Oct 282024
A dive into how Azure OpenAI works, what different deployment types mean for your use and how to think about the high availability of your deployments. 🔎 Looking for content on a particular topic? Search the channel. If I have something it will be there! 🤔 Due to the channel growth and number of people wanting help I no longer can answer or even read questions, and they will just stay in the moderation queue never to be seen so please post questions to other sites like Reddit, Microsoft Community Hub etc. ▬▬▬▬▬▬ C H A P T E R S ⏰ ▬▬▬▬▬▬ 00:00 - Introduction 00:21 - Generative API is stateless 02:21 - Regional Azure OpenAI resource 04:54 - Capacity pools 08:27 - Responsible AI 09:27 - Model deployment types 11:21 - Standard 11:56 - Global 12:17 - Network vs inference latency 14:42 - Intelligent routing 17:47 - Quota vs available capacity 19:30 - Data zone and data residency 22:50 - Availability benefits? 23:52 - Resource is regional 24:31 - Multiple regional resources 25:53 - Enabling in the application 26:49 - API Management 29:08 - Prompt caching impact 31:25 - Provisioned service 32:15 - PayGo features 36:26 - PTU features 43:24 - Azure reservations 45:36 - Batch service 47:26 - Summary 49:54 - Close ▬▬▬▬▬▬ K E Y L I N K S 🔗 ▬▬▬▬▬▬ ► Whiteboard: 🔗 https://github.com/johnthebrit/Random... ► Azure OpenAI Pricing: 🔗 https://azure.microsoft.com/pricing/d... ► PTU Calculator: 🔗 https://oai.azure.com/portal/calculator ► Official resiliency documentation: 🔗 https://learn.microsoft.com/azure/ai-... ▬▬▬▬▬▬ Want to learn more? 🚀 ▬▬▬▬▬▬ 📖 Recommended Learning Path for Azure 🔗 https://learn.onboardtoazure.com 🥇 Certification Content Repository 🔗 https://github.com/johnthebrit/Certif... 📅 Weekly Azure Update 🔗    • Azure Infrastructure Updates   ☁ Azure Master Class 🔗    • Microsoft Azure Master Class v2 (bein...   ⚙ DevOps Master Class 🔗    • DevOps Master Class   💻 PowerShell Master Class 🔗    • PowerShell Master Class   🎓 Certification Cram Videos 🔗    • Microsoft Certification Exam Prep Videos   🧠 Mentoring Content 🔗    • Virtual Mentoring   ❔ Questions? Maybe I answered it in my FAQ 🔗 https://savilltech.com/faq 👕 Cure Childhood Cancer Charity T-Shirt Channel Store 🔗 https://johns-t-shirts-store.creator-... 👂 Enable the subtitles and from there you can translate to your native language via the auto-translate feature in settings!    • YouTube Captions and Auto Translate Q...   for a demo of using this feature. SUBSCRIBE ✅    / @ntfaqguy   #Azure #AI #openai

Follow along using the transcript.

John Savill's Technical Training

317K subscribers