Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Bulk read and update millions of items in seconds with the Azure Cosmos DB Spark Connector!

Microsoft Developer
588K subscribers
<__slot-el>
<__slot-el>
1.4K views 1 year ago #azure #azurecosmosdb #azurecosmosdbconf
Theo van Kraay - Microsoft Bulk read and update millions of items in seconds with the Azure Cosmos DB Spark Connector! Session details In modern day IoT scenarios its common to receive batches of updates in the tens of millions from pre-processed signals - for example digital twin - from fleets of billions of devices. Suppose you need to read each item before doing the update - how do you process these updates in seconds without using enormous client resources? This session walks through the latest optimizations for bulk read/replace/patch in the Spark Connector to vastly improve the efficiency of this kind of operation. Bio Theo is passionate about NoSQL and distributed computing. He joined Microsoft in 2017 and has been in the Azure Cosmos DB Engineering team as a Program Manager since 2019. He is currently leads product management of Java Ecosystem, high availability, and Cassandra offerings for Azure Cosmos DB. #azurecosmosdb #azurecosmos …...more
...more
Bulk read and update millions of items in seconds with the Azure Cosmos DB Spark Connector!
13Likes
1,437Views
2024Apr 16
Theo van Kraay - Microsoft Bulk read and update millions of items in seconds with the Azure Cosmos DB Spark Connector! Session details In modern day IoT scenarios its common to receive batches of updates in the tens of millions from pre-processed signals - for example digital twin - from fleets of billions of devices. Suppose you need to read each item before doing the update - how do you process these updates in seconds without using enormous client resources? This session walks through the latest optimizations for bulk read/replace/patch in the Spark Connector to vastly improve the efficiency of this kind of operation. Bio Theo is passionate about NoSQL and distributed computing. He joined Microsoft in 2017 and has been in the Azure Cosmos DB Engineering team as a Program Manager since 2019. He is currently leads product management of Java Ecosystem, high availability, and Cassandra offerings for Azure Cosmos DB. #azurecosmosdb #azurecosmosdbconf #azure Links: See all the videos from Azure Cosmos DB Conf 2024: https://aka.ms/AzureCosmosDBConf/videos Try Azure Cosmos DB Free: https://aka.ms/trycosmosdb Microsoft Developers AI Learning Hackathon: https://aka.ms/azurecosmosdbhackathon Try Azure Cosmos DB free with Azure AI Advantage: https://aka.ms/AzureAIAdvantage Subscribe to Azure Cosmos DB on YouTube:    / azurecosmosdb   Follow Azure Cosmos DB on X:   / azurecosmosdb   Follow Azure Cosmos DB on LinkedIn:   / azure-cosmos-db   Watch Azure Cosmos DB Conf 2024 for an unparalleled learning experience, featuring a carefully curated lineup of 20+ sessions, including exclusive on-demand presentations and a dynamic three-hour live show. Our sessions, delivered by Azure Cosmos DB product managers, Microsoft experts, and esteemed community leaders, are tailored for today's tech professionals in concise 15-minute formats.

Follow along using the transcript.

Microsoft Developer

588K subscribers