Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Auto scaling Azure Cosmos DB for PostgreSQL with Citus, Grafana & Azure Serverless | Citus Con 2023

Microsoft Developer
589K subscribers
<__slot-el>
<__slot-el>
1.1K views 2 years ago #PostgreSQL #CitusCon #Citus
Video of a conference talk and demo about auto scaling Azure Cosmos DB for PostgreSQL with Citus, Grafana, & Azure Serverless, delivered by Lucas Borges at Citus Con: An Event for Postgres 2023. Azure Cosmos DB for PostgreSQL is a managed service offering that is powered by the open-source Citus database extension to Postgres. One of the top Citus features is the ability to run PostgreSQL at any scale, on a single node as well as a distributed database cluster. This talk includes a demo to show what you can do as your application needs to scale: You can add more nodes to the Azure Cosmos DB for PostgreSQL cluster, rebalance existing data across the new Postgres nodes, and seamlessly scale out. However, these operations require manual intervention: a) first you must create alerts on metrics, b) then, based on those alerts, you need to add more nodes, c) then you must kick off and monitor the shard rebalancer. Automating these steps will give yo …...more
...more
Auto scaling Azure Cosmos DB for PostgreSQL with Citus, Grafana & Azure Serverless | Citus Con 2023
38Likes
1,191Views
2023Apr 18
Video of a conference talk and demo about auto scaling Azure Cosmos DB for PostgreSQL with Citus, Grafana, & Azure Serverless, delivered by Lucas Borges at Citus Con: An Event for Postgres 2023. Azure Cosmos DB for PostgreSQL is a managed service offering that is powered by the open-source Citus database extension to Postgres. One of the top Citus features is the ability to run PostgreSQL at any scale, on a single node as well as a distributed database cluster. This talk includes a demo to show what you can do as your application needs to scale: You can add more nodes to the Azure Cosmos DB for PostgreSQL cluster, rebalance existing data across the new Postgres nodes, and seamlessly scale out. However, these operations require manual intervention: a) first you must create alerts on metrics, b) then, based on those alerts, you need to add more nodes, c) then you must kick off and monitor the shard rebalancer. Automating these steps will give you a complete auto scale experience—and make your life so much easier. The demo shows you how to “auto scale” by using existing tools such as Grafana & Azure Serverless (aka Azure Functions.) ■ Configuring Grafana to capture metrics from Azure Cosmos DB for PostgreSQL ■ Configure alerts based on those metrics ■ Trigger Azure Serverless function using Grafana alerts to automate the process of scaling out, both automatic node addition and shard rebalancer maintenance ■ As icing on the cake, we will also demonstrate automatic tenant isolation! Lucas Borges Fernandes is a Brazilian software engineer with years of experience in the field of application development. He also has a MSc in the field of distributed systems. He's currently working at Microsoft as a Customer Engineer for the Azure Cosmos DB for PostgreSQL team. ► Video bookmarks: ⏩ 00:00 Introduction ⏩ 03:33 Why auto scaling? ⏩ 04:59 Auto scaling a Citus cluster ⏩ 08:31 Grafana ⏩ 11:54 Azure Functions (Serverless) ⏩ 13:23 Azure Resource Manager (ARM) ⏩ 15:12 Demo of Autoscaling Azure Cosmos DB for PostgreSQL 📕 Everything you need to know about Citus Con: An Event for Postgres can be found at: https://aka.ms/cituscon ✅ Learn more: Watch more Citus Con talks: https://aka.ms/cituscon-playlist 📌 Let’s connect:   Twitter – @CitusCon,   / cituscon   ⭐ Stay connected with the Citus open source project on GitHub: https://github.com/citusdata/citus 🔔 Subscribe to the Citus monthly technical newsletter: https://aka.ms/citus-newsletter More resources: 📣 Slides for this talk: https://speakerdeck.com/azuredbpostgr... ■ Docs – Azure Cosmos DB for PostgreSQL: https://learn.microsoft.com/azure/cos... ■ Docs – Azure Managed Grafana: https://learn.microsoft.com/azure/man... ■ Docs – Azure Functions: https://learn.microsoft.com/azure/azu... ■ Docs – Azure Resource Manager (ARM): https://learn.microsoft.com/azure/azu... ■ Docs – Azure SDKs for JavaScript and TypeScript: https://learn.microsoft.com/azure/dev... #CitusCon #PostgreSQL #Citus

Follow along using the transcript.

Microsoft Developer

589K subscribers