Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Azure API Management with Generative AI

John Savill's Technical Training
318K subscribers
<__slot-el>
<__slot-el>
9.8K views 6 months ago #Azure #johnsavillstechnicaltraining #Cloud
Diving into using APIM with generative AI models. 🔎 Looking for content on a particular topic? Search the channel. If I have something it will be there! 🤔 Due to the channel growth and number of people wanting help I no longer can answer or even read questions and they will just stay in the moderation queue never to be seen so please post questions to other sites like Reddit, Microsoft Community Hub etc. ▬▬▬▬▬▬ C H A P T E R S ⏰ ▬▬▬▬▬▬ 00:00 - Introduction 00:27 - Adding APIM into the mix 03:16 - LLM supported 05:24 - Authentication to the LLM 06:21 - Adding LLM to APIM 06:47 - Azure Portal onboarding experience 08:30 - Some key GenAI capabilities in APIM 08:46 - Token limits 12:37 - Emit token metrics 14:20 - Load balancing and switching between instances 21:25 - Logging prompts 23:17 - Semantic caching 25:31 - Requirements 27:40 - How it works 29:58 - Demo 35:01 - Chaining? 35:38 - Great example scenario repo 36:48 - Summary 38:57 - Cl …...more
...more
Azure API Management with Generative AI
214Likes
9,839Views
Sep 302024
Diving into using APIM with generative AI models. 🔎 Looking for content on a particular topic? Search the channel. If I have something it will be there! 🤔 Due to the channel growth and number of people wanting help I no longer can answer or even read questions and they will just stay in the moderation queue never to be seen so please post questions to other sites like Reddit, Microsoft Community Hub etc. ▬▬▬▬▬▬ C H A P T E R S ⏰ ▬▬▬▬▬▬ 00:00 - Introduction 00:27 - Adding APIM into the mix 03:16 - LLM supported 05:24 - Authentication to the LLM 06:21 - Adding LLM to APIM 06:47 - Azure Portal onboarding experience 08:30 - Some key GenAI capabilities in APIM 08:46 - Token limits 12:37 - Emit token metrics 14:20 - Load balancing and switching between instances 21:25 - Logging prompts 23:17 - Semantic caching 25:31 - Requirements 27:40 - How it works 29:58 - Demo 35:01 - Chaining? 35:38 - Great example scenario repo 36:48 - Summary 38:57 - Close ▬▬▬▬▬▬ K E Y L I N K S 🔗 ▬▬▬▬▬▬ ► Whiteboard: 🔗 https://github.com/johnthebrit/Random... ► Git Repo of APIM and GenAI scenarios: 🔗 https://github.com/Azure-Samples/AI-G... ► Token limit policy: 🔗 https://learn.microsoft.com/azure/api... ► Emit metrics policy: 🔗 https://learn.microsoft.com/azure/api... ▬▬▬▬▬▬ Want to learn more? 🚀 ▬▬▬▬▬▬ 📖 Recommended Learning Path for Azure 🔗 https://learn.onboardtoazure.com 🥇 Certification Content Repository 🔗 https://github.com/johnthebrit/Certif... 📅 Weekly Azure Update 🔗    • Azure Infrastructure Updates   ☁ Azure Master Class 🔗    • Microsoft Azure Master Class v2 (bein...   ⚙ DevOps Master Class 🔗    • DevOps Master Class   💻 PowerShell Master Class 🔗    • PowerShell Master Class   🎓 Certification Cram Videos 🔗    • Microsoft Certification Exam Prep Videos   🧠 Mentoring Content 🔗    • Virtual Mentoring   ❔ Questions? Maybe I answered it in my FAQ 🔗 https://savilltech.com/faq 👕 Cure Childhood Cancer Charity T-Shirt Channel Store 🔗 https://johns-t-shirts-store.creator-... 👂 Enable the subtitles and from there you can translate to your native language via the auto-translate feature in settings!    • YouTube Captions and Auto Translate Q...   for a demo of using this feature. SUBSCRIBE ✅    / @ntfaqguy   #Azure #Cloud #johnsavillstechnicaltraining

Follow along using the transcript.

John Savill's Technical Training

318K subscribers