Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Change Data Capture and Managed Airflow in Azure Data Factory | Azure Friday

Microsoft Azure
341K subscribers
<__slot-el>
<__slot-el>
5.8K views 2 years ago #Azure #Microsoft #AzureFriday
Mark Kromer and Abhishek Narain join Scott Hanselman to talk about two new capabilities in Azure Data Factory: Change Data Capture (CDC) and Managed Airflow. Change Data Capture in Azure Data Factory automatically detects data changes at the source without requiring complex designing or coding. Managed Airflow in Azure Data Factory is a managed orchestration service for Apache Airflow that simplifies the creation and management of Airflow environments on which you can operate end-to-end data pipelines at scale. 00:00 – Introduction 00:40 – Change Data Capture 01:17 – CDC demo 07:59 – Managed Airflow 09:06 – Managed Airflow demo 14:33 – Wrap-up ■ Change data capture resource overview - https://aka.ms/azfr/744/01 ■ How to capture changed data from ADLS Gen2 to Azure SQL DB using a Change Data Capture (CDC) resource - https://aka.ms/azfr/744/02 ■ What is Azure Data Factory Managed Airflow? - https://aka.ms/azfr/744/03 ■ How does Azure Data Fac …...more
...more
Change Data Capture and Managed Airflow in Azure Data Factory | Azure Friday
109Likes
5,867Views
2023Mar 17
Mark Kromer and Abhishek Narain join Scott Hanselman to talk about two new capabilities in Azure Data Factory: Change Data Capture (CDC) and Managed Airflow. Change Data Capture in Azure Data Factory automatically detects data changes at the source without requiring complex designing or coding. Managed Airflow in Azure Data Factory is a managed orchestration service for Apache Airflow that simplifies the creation and management of Airflow environments on which you can operate end-to-end data pipelines at scale. 00:00 – Introduction 00:40 – Change Data Capture 01:17 – CDC demo 07:59 – Managed Airflow 09:06 – Managed Airflow demo 14:33 – Wrap-up ■ Change data capture resource overview - https://aka.ms/azfr/744/01 ■ How to capture changed data from ADLS Gen2 to Azure SQL DB using a Change Data Capture (CDC) resource - https://aka.ms/azfr/744/02 ■ What is Azure Data Factory Managed Airflow? - https://aka.ms/azfr/744/03 ■ How does Azure Data Factory Managed Airflow work? - https://aka.ms/azfr/744/04 ■ Azure Data Factory - https://aka.ms/azfr/744/05 ■ Create a Pay-as-You-Go account (Azure) – https://aka.ms/azfr/744/payg ■ Create a free account (Azure) – https://aka.ms/azfr/744/free Connect with us: ■ Scott Hanselman | @SHanselman –   / shanselman   ■ Mark Kromer | @KromerBigData –   / kromerbigdata   ■ Abhishek Narain | @NarainAbhishek –   / narainabhishek   ■ Azure Data Factory | @AzDataFactory –   / azdatafactory   ■ Azure Friday | @AzureFriday –   / azurefriday   ■ Azure | @Azure –   / azure   #Microsoft #Azure #AzureFriday

Follow along using the transcript.

Microsoft Azure

341K subscribers