Azure Data Factory

Service Profile Documentation Resources Videos

Documentation

Homepage

Overview

Overview

Azure Data Factory is Azure's cloud ETL service for scale-out serverless data integration and data transformation. It offers a code-free UI for intuitive authoring and single-pane-of-glass monitoring and management. You can also lift and shift existing SSIS packages to Azure and run them with full compatibility in ADF. SSIS Integration Runtime offers a fully managed service, so you don't have to worry about infrastructure management.

Pricing SLAs Limits Twitter Customer Stories

Getting Started

Getting Started

Introduction to Azure Data Factory

10/7/2015, Video, 0:59:31

The data landscape is more varied than ever with unstructured and structured data originating from many cloud and on-premises sources. Data Factory enables you to process...
Orchestrating Data and Services with Azure Data Factory

2/25/2016, Trainings

Exploring data orchestration concepts? Check out this course on the basic capabilities of Azure Data Factory (ADF). Get an overview of advanced analytics, and see how Azure...
Intro to Data Factory Deep Dive

10/7/2015, Video, 0:31:34

This video takes a deeper dive into the features and functions of the Azure Data Factory orchestration engineLearn more: http://aka.ms/g7hlpt
Building Hybrid Big Data Pipelines with Azure Data Factory

10/7/2015, Video, 1:11:26

This video takes a deeper dive into how Azure Data Factory can be used to build hybrid big data analytics pipelines through the lens of an automated risk processing use case...

Videos

Building geospatial apps on Postgres, PostGIS, & Citus at large scale | Citus Con 2022

0:30:12

4/26/2022, YouTube: Microsoft Developer

Building geospatial apps on Postgres, PostGIS, & Citus at large scale |...

Choose the Right SQL Engine Size in Synapse | Data Exposed: MVP Edition

0:15:45

4/26/2022, YouTube: Microsoft Developer

Choose the Right SQL Engine Size in Synapse | Data Exposed: MVP Edition

Exciting New Features in Azure Data Factory | Data Exposed

0:12:47

3/17/2022, YouTube: Microsoft Developer

Exciting New Features in Azure Data Factory | Data Exposed

AzureFunBytes Episode 70 - Intro to @Azure Stream Analytics with @fleid_bi

0:00:00

2/16/2022, YouTube: IT Ops Talk

AzureFunBytes Episode 70 - Intro to @Azure Stream Analytics with @fleid_bi

AzureFunBytes Episode 70 - Intro to @Azure Stream Analytics with @fleid_bi

0:00:00

2/16/2022, YouTube: DevOps at Microsoft

AzureFunBytes Episode 70 - Intro to @Azure Stream Analytics with @fleid_bi

Getting Data into Azure Cosmos DB | Azure Cosmos DB Essentials Season 2

0:03:59

12/13/2021, YouTube: Microsoft Azure

Getting Data into Azure Cosmos DB | Azure Cosmos DB Essentials Season 2

more...

Learning

Learning Paths

Data integration at scale with Azure Data Factory

Published: 9/12/2020, Length: 2:43:00

Data integration at scale with Azure Data Factory

Learning Modules

Perform code-free transformation at scale with Azure Data Factory

Published: 9/11/2020, Length: 0:58:00

Integrate data with Azure Data Factory

Published: 9/24/2020, Length: 1:02:00

Petabyte-scale ingestion with Azure Data Factory

Published: 9/27/2020, Length: 0:43:00

Orchestrate data movement and transformation in Azure Data Factory

Published: 11/6/2020, Length: 0:38:00

Execute existing SSIS packages in Azure Data Factory

Published: 11/6/2020, Length: 0:24:00

more...

Azure Data Factory News

5/20/2022,

Integrating IT and OT Data with Azure Digital Twins, Azure Data Explorer, and Azure Synapse

To answer business questions in manufacturing, supply chain, and other domains, customers often need to combine Information Technology (IT) data with Operational Technology (OT) data. This means...

5/19/2022, MS Tech Community

Discover Microsoft Certified: Customer Data Platform Specialty

Are you a functional consultant, data engineer, or data analyst who specializes in implementing solutions that provide insight into customer profiles? Do you have experience designing solutions...

5/19/2022, MS Tech Community

Bring Vision to Life with Three Horizons, Data Mesh, Data Lakehouse, and Azure Cloud Scale Analytics

Introduction: Many of you may have been focused on analytics for years and have shown audacity, acumen, and determination in improving your decision-making and the decisions of those around...

5/17/2022, MS Tech Community

ADLS Gen1 to ADLS Gen2 Migrations: Options and Best Practices

If you are not aware Azure Data Lake Storage (ADLS) Gen1 is being replaced by ADLS Gen2. The end of life for Gen1 is Feb 2024 (Retirement Announcement). FastTrack along with the Customer Support...

5/17/2022, MS Tech Community

Moving Postgres data 26X faster with Azure Data Factory

Moving data to and from Postgres databases is one of the most common operations if you are working with large amounts of data. And it can also be one of the most time-consuming. Imagine you need...

5/13/2022, MS Tech Community

Migrate Amazon RDS for SQL Server to Azure SQL Managed Instance – Part 2 (Native Backup & Restore)

In the previous post, Migrate Amazon RDS for SQL Server to Azure SQL Managed Instance - Overview (microsoft.com), we have introduced an overview of the series and summarized different migration...

5/12/2022, MS Tech Community

Create ADF Events trigger that runs an ADF pipeline in response to Azure Storage events.

Storage Event Trigger in Azure Data Factory is the building block to build an event-driven ETL/ELT architecture (EDA). Data Factory's native integration with Azure Event Grid let you trigger...

4/30/2022, MS Tech Community

Custom role to restrict Azure Data Factory pipeline developers to create/delete linked services

Restrict ADF pipeline developers to create connection using linked services Azure Data Factory has some built-in role such as Data Factory Contributor. Once this role is granted to the...

4/29/2022, MS Tech Community

Data flow sink supports user db schema for staging in Azure Synapse and PostgreSQL connectors

To achieve the fastest loading speed for moving data into a data warehouse table, load data into a staging table. Consider that loading is usually a two-step process in which you first load to a...

4/28/2022, MS Tech Community

Azure Functions available in ADF managed virtual network

Azure Functions is a serverless solution that allows you to write less code, maintain less infrastructure, and save on costs. Instead of worrying about deploying and maintaining servers, the...

4/28/2022, MS Tech Community

Migrate Amazon RDS for SQL Server to Azure SQL Managed Instance – Part 1 (Overview)

Applications are closely dependent on the databases and application evolution is frequently connected with an upgrade of the application database. Database migration is process of moving...

4/27/2022, MS Tech Community

Announcing General Availability of Change Data Capture (CDC) on Azure SQL Database

We are excited to announce the general availability (GA) of change data capture (CDC) in Azure SQL Database.What is Change data capture (CDC)? CDC provides historical change information for a...

4/26/2022, MS Tech Community

ADF Monitoring Improvements

The Azure Data Factory team is happy to announce several new improvements to the monitoring experience. These improvements and new features are based off community feedback and votes, social...

4/26/2022, MS Tech Community

Choose the Right SQL Engine Size in Synapse | Data Exposed: MVP Edition

You’ve probably been told that Azure Synapse is just for very large data projects. Which is true. It is designed for limitless storage and super powerful compute. But there are ways to start with...

4/26/2022, MS Tech Community

Choose the Right SQL Engine Size in Synapse | Data Exposed: MVP Edition

You’ve probably been told that Azure Synapse is just for very large data projects. Which is true. It is designed for limitless storage and super powerful compute. But there are ways to start with...

4/22/2022, MS Tech Community

Deletion of logs from $logs container from ADLS gen2 storage account using Azure Data Factory (ADF)

Background: Many times, we have a requirement to delete the older logs from $logs as the Retention days is not supported at the moment for ADLS gen2 storage account Please refer to article...

4/20/2022, MS Tech Community

Microsoft 365 Platform Call – 19th of April 2022

Call summary Welcome to the weekly call focused on capabilities of the Microsoft 365 platform. In this particular call, we highlighted recently announced and key existing resources as well as...

4/13/2022, MS Tech Community

Azure Marketplace new offers – April 13, 2022

We continue to expand the Azure Marketplace ecosystem. For this volume, 104 new offers successfully met the onboarding criteria and went live. See details of the new offers below: Get it...

3/31/2022, MS Tech Community

Azure Synapse Analytics March Update 2022

Azure Synapse Analytics March Update 2022 Welcome to the March 2022 Azure Synapse update! This month, we have SQL, Apache Spark for Synapse, Security, Data integration, and Notebook updates...

3/30/2022, MS Tech Community

Data Cataloging with Azure Purview

Many big organisations are moving towards decentralisation of data teams. In a decentralised data team setup — where there will be multiple data teams, producing data sets covering different...