Sign in to confirm you’re not a bot

This helps protect our community. Learn more

Introducing Managed Airflow in Azure Data Factory

Microsoft Reactor

113K subscribers

9.3K views Streamed 2 years ago

Azure Data Factory (ADF) is a fully managed cloud service built for petabyte-scale data ingestion, transformation, and orchestration at scale. Azure Data Factory provides data engineers with a familiar and productive environment for authoring their data integration pipelines and data flows for large-scale code-free transformations. Users have sophisticated data pipelines and data transformation capabilities to author robust data integration tasks that operate over large amounts of data. Hundreds of connectors enable data-source-specific connectivity to ingest data from diverse data sources (e.g., multi-cloud, SaaS, on-premises), transform data at scale, and more. Azure Data Factory Managed Airflow provides a managed orchestration service for Apache Airflow that simplifies the creation and management of Airflow environments. In addition, it natively integrates Apache Airflow with Azure Active Directory for a single sign-on and a more secure solution (instead of requiring basic auth for logins). Speaker: Abhishek Narain is a Principal Program Manager in the Data Integration group @Microsoft, leading the product efforts on Azure Data Factory – a hybrid, cloud-scale ETL service on Azure. [eventID:18529]

...more

...more

Introducing Managed Airflow in Azure Data Factory

Azure Data Factory (ADF) is a fully managed cloud service built for petabyte-scale data ingestion, transformation, and orchestration at scale. Azure Data Factory provides data engineers with a familiar and productive environment for authoring their data integration pipelines and data flows for large-scale code-free transformations. Users have sophisticated data pipelines and data transformation capabilities to author robust data integration tasks that operate over large amounts of data. Hundreds of connectors enable data-source-specific connectivity to ingest data from diverse data sources (e.g., multi-cloud, SaaS, on-premises), transform data at scale, and more. Azure Data Factory Managed Airflow provides a managed orchestration service for Apache Airflow that simplifies the creation and management of Airflow environments. In addition, it natively integrates Apache Airflow with Azure Active Directory for a single sign-on and a more secure solution (instead of requiring basic auth for logins). Speaker: Abhishek Narain is a Principal Program Manager in the Data Integration group @Microsoft, leading the product efforts on Azure Data Factory – a hybrid, cloud-scale ETL service on Azure. [eventID:18529]

Transcript

Follow along using the transcript.

Microsoft Reactor

113K subscribers

Live chat replay is not available for this video.