Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Build a scalable Chat Application with Azure Cosmos DB and Kubernetes Service

Microsoft Reactor
114K subscribers
<__slot-el>
<__slot-el>
379 views Streamed 10 months ago #ai #mongodb #azurecosmosdb
In this session, you'll learn how to build a scalable chat application utilizing Azure Cosmos DB and Azure Kubernetes Service (AKS). We'll set up Azure Cosmos DB for MongoDB for logging chat history and Azure File Storage for storing weights of our language model. Then, we'll deploy the Hugging Face Text Generation Inference (TGI) and Chat UI as individual services on AKS. We'll also configure Nginx Ingress Controller for TLS termination to ensure secure communication. By the end, we'll have a fully functional chat application running on Azure infrastructure #azurecosmosdb #ai #mongodb Useful links: • Azure Cosmos DB for Mon …...more
...more
Build a scalable Chat Application with Azure Cosmos DB and Kubernetes Service
In this session, you'll learn how to build a scalable chat application utilizing Azure Cosmos DB and Azure Kubernetes Service (AKS). We'll set up Azure Cosmos DB for MongoDB for logging chat history and Azure File Storage for storing weights of our language model. Then, we'll deploy the Hugging Face Text Generation Inference (TGI) and Chat UI as individual services on AKS. We'll also configure Nginx Ingress Controller for TLS termination to ensure secure communication. By the end, we'll have a fully functional chat application running on Azure infrastructure #azurecosmosdb #ai #mongodb Useful links: • Azure Cosmos DB for MongoDB vCore documentation • Use vector search on embeddings in Azure Cosmos DB for MongoDB vCore • Subscribe to this channel - https://aka.ms/AzureCosmosDBYouTube • Check out past meetups on YouTube to catch anything you might have missed -    • Global User Group Meetups   • Want to present at a future meetup? Fill out our intake form - https://aka.ms/AzureCosmosDB/UserGrou... • Try Azure Cosmos DB Free - https://aka.ms/trycosmosdb • Microsoft Reactor - https://aka.ms/Reactor • Build a custom Chatbot using Hugging Face Chat UI and Cosmos DB on Azure Kubernetes Service Speaker: Shahzeb Naveed Bio: Shahzeb Naveed is an experienced data science professional with over 4 years of industry experience across the automotive, telecom, banking, and CPG sectors. He specializes in data science, generative AI, and cloud technologies and currently serves as a Machine Learning Engineer at General Motors Canada. [eventID:22598]

Follow along using the transcript.

Microsoft Reactor

114K subscribers