Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Learn Live: Azure OpenAI Application Identity & Security

Microsoft Reactor
113K subscribers
<__slot-el>
<__slot-el>
874 views Streamed 1 year ago
Full series information: https://aka.ms/learnlive-fta3 More info here: https://aka.ms/learnlive-fta3-Ep12 Follow on Microsoft Learn: In this session we will cover how customer can enable authentication and authorization in their generative AI application using Entra ID We will also cover how to secure Azure OpenAI through APIM subscription or managed identity. --------------------- Learning objectives  …...more
...more

Welcome and introductions

0:00

Learning objectives

3:03

Azure OpenAI auth impediments

5:33

Scenario 1: Using external identity providers or different Microsoft Entra ID tenants

9:07

Scenario 2: Managing access for multiple client applications with alternative Azure OpenAI credentials

12:08

Scenario 3: Unified authentication across disparate generative AI services

15:51

Successful outcome

18:00

Solution: Establish user authorization and generative AI service authentication via an API gateway

19:24

User authentication and authorization via an identity provider

25:01

Demo: User auth using Microsoft Entra ID

27:01

Validating user identity to grant authorization to generative AI services

43:21

Demo: Validating user authorization to Azure OpenAI via Azure API Management

52:34

Authenticating with Azure OpenAI using Managed Identity

1:01:52

Authenticating with other generative AI services

1:04:08

Demo: Authenticating with Azure OpenAI using Managed Identity via Azure API Management

1:08:39

Summary and conclusion

1:20:39
Learn Live: Azure OpenAI Application Identity & Security
Full series information: https://aka.ms/learnlive-fta3 More info here: https://aka.ms/learnlive-fta3-Ep12 Follow on Microsoft Learn: In this session we will cover how customer can enable authentication and authorization in their generative AI application using Entra ID We will also cover how to secure Azure OpenAI through APIM subscription or managed identity. --------------------- Learning objectives
  • Use of EntraID or another IdP to authenticate and authorize end-users of Intelligent Applications.
  • Register Intelligent App and AOAI API with Identity provider. Create policies to validate issued identity JWT token.
  • Create Managed Identity to authenticate with the backend AOAI, inbound policy for auth of the requests against AOAI service.
  • Extending this architecture to other LLM Services and External IdPs.
--------------------- Chapters -------- 00:00 - Welcome and introductions 03:03 - Learning objectives 05:33 - Azure OpenAI auth impediments 09:07 - Scenario 1: Using external identity providers or different Microsoft Entra ID tenants 12:08 - Scenario 2: Managing access for multiple client applications with alternative Azure OpenAI credentials 15:51 - Scenario 3: Unified authentication across disparate generative AI services 18:00 - Successful outcome 19:24 - Solution: Establish user authorization and generative AI service authentication via an API gateway 25:01 - User authentication and authorization via an identity provider 27:01 - Demo: User auth using Microsoft Entra ID 43:21 - Validating user identity to grant authorization to generative AI services 52:34 - Demo: Validating user authorization to Azure OpenAI via Azure API Management 1:01:52 - Authenticating with Azure OpenAI using Managed Identity 1:04:08 - Authenticating with other generative AI services 1:08:39 - Demo: Authenticating with Azure OpenAI using Managed Identity via Azure API Management 1:20:39 - Summary and conclusion --------------------- Presenters Bappaditya Banerjee Senior Customer Engineer Microsoft Lizet Pena De Sola Senior Customer Engineer Microsoft Moderators James Croft Customer Engineer Microsoft

Follow along using the transcript.

Microsoft Reactor

113K subscribers
Live chat replay is not available for this video.