Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Run an Automated Evaluation in Azure AI Foundry

Microsoft Developer
588K subscribers
<__slot-el>
<__slot-el>
1.9K views 8 months ago
Automated measurement is useful for measuring at scale with increased coverage to provide comprehensive results. It's also helpful for ongoing measurement to monitor for any regression as the system, usage, and mitigations evolve. In this demo, we'll demonstrate how to create, configure, and run an automated evaluation in Azure AI Studio. Disclosure: This demo contains an AI-generated voice. Chapters: 00:00 - Introduction 00:59 - Create a new evaluation 01:52 - Review evaluation results Resources: Azure AI Foundry - https://ai.azure.com Microsoft Learn Evaluations Path - https://aka.ms/RAI-evaluations-path ...more
...more
Run an Automated Evaluation in Azure AI Foundry
11Likes
1,952Views
Aug 152024
Automated measurement is useful for measuring at scale with increased coverage to provide comprehensive results. It's also helpful for ongoing measurement to monitor for any regression as the system, usage, and mitigations evolve. In this demo, we'll demonstrate how to create, configure, and run an automated evaluation in Azure AI Studio. Disclosure: This demo contains an AI-generated voice. Chapters: 00:00 - Introduction 00:59 - Create a new evaluation 01:52 - Review evaluation results Resources: Azure AI Foundry - https://ai.azure.com Microsoft Learn Evaluations Path - https://aka.ms/RAI-evaluations-path

Follow along using the transcript.

Microsoft Developer

588K subscribers