Azure Data Factory

Service Profile Documentation Resources Videos

Documentation

Homepage SLAs Limits Learning Twitter Customer Stories

Getting Started

  1. Introduction to Azure Data Factory
    10/7/2015, Video, 0:59:31
    The data landscape is more varied than ever with unstructured and structured data originating from many cloud and on-premises sources. Data Factory enables you to process...
  2. Orchestrating Data and Services with Azure Data Factory
    2/25/2016, Trainings
    Exploring data orchestration concepts? Check out this course on the basic capabilities of Azure Data Factory (ADF). Get an overview of advanced analytics, and see how Azure...
  3. Intro to Data Factory Deep Dive
    10/7/2015, Video, 0:31:34
    This video takes a deeper dive into the features and functions of the Azure Data Factory orchestration engineLearn more: http://aka.ms/g7hlpt
  4. Building Hybrid Big Data Pipelines with Azure Data Factory
    10/7/2015, Video, 1:11:26
    This video takes a deeper dive into how Azure Data Factory can be used to build hybrid big data analytics pipelines through the lens of an automated risk processing use case...

Azure Data Factory News

Data Factory adds schema import, connection tests, and custom sink ordering to data flows
2/7/2020, Service Updates
Azure Data Factory added several new features to mapping data flows this week: Import schema and test connection from debug cluster, custom sink ordering.
Data Factory Adds Managed Identity Support to Data Flows
1/29/2020, Service Updates
Azure Data Factory users can now build Mapping Data Flows utilized Managed Identity (formerly MSI) for Azure Data Lake Store Gen 2, Azure SQL Database, and Azure Synapse Analytics (formerly SQL DW).
Azure Data Factory supports loading data into Azure Synapse Analytics using COPY statement
1/18/2020, Service Updates
Azure Synapse Analytics introduced a new COPY statement (preview) which provides the most flexibility for high-throughput data ingestion.
Azure Data Factory copy activity supports resume from last failed run
1/18/2020, Service Updates
Azure Data Factory copy activity now supports resume from last failed run when you copy files between file-based data stores to ease large volumes of data ingestion and migration.
Azure Data Factory supports copying data into SFTP
1/18/2020, Service Updates
Azure Data Factory now supports SFTP as a sink and as a source. Use copy activity to copy data from any supported data store to your SFTP server located on-premises or in the cloud.
Transform your data with Azure Data Factory | DATA30
1/16/2020, YouTube: Microsoft Ignite [0:48:59]
Start by creating data flows in debug mode so that you can validate your transformation logic interactively. Next, add a data flow activity to your pipeline to execute and test your data flow in...
Ingesting data with Azure Data Factory | DATA20
1/14/2020, YouTube: Microsoft Ignite [0:46:31]
In this experience, walk through creating a pipeline copy activity to copy a file to an Azure blob storage container, so we can prepare the file to be processed later for transformation.
Delivering the MDW with Azure SQL Data Warehouse Azure Databricks Azure Data Factory | DATA10
1/14/2020, YouTube: Microsoft Ignite [0:46:28]
In this experience, see how Azure Data Factory (ADF), Azure Databricks, and Azure SQL Data Warehouse (SQL DW) can be used together to build a modern data warehouse. Start by using Azure Data...
PaaSport to paradise: Lifting and shifting with Azure SQL Database + SSIS in Azure | BRK3209
1/14/2020, YouTube: Microsoft Ignite [0:47:40]
This session focuses on the all PaaS solution of Azure SQL DB/Managed Instance (MI) + SSIS in Azure Data Factory (ADF) to lift and shift, modernize, and extend ETL workflows. We first show you...
Code-free ETL using Azure Data Factory | BRK3045
1/14/2020, YouTube: Microsoft Ignite [0:41:31]
Customers face common data integration problems every day. This session showcases how to use Azure SQL Data Warehouse, Azure Data Factory, Azure Data Lake Store, Azure Databricks, Azure Key Vault...
Achieving petabyte-scale data ingestion with Azure Data Factory | BRK3046
1/14/2020, YouTube: Microsoft Ignite [0:57:52]
In this session, we talk about the common data ingest challenges, patterns, and best practices based on our learnings from working directly with customers and partners. We walk through real-world...
Smart cities: Augmenting humanity with intelligent cloud + edge | THR3057
1/14/2020, YouTube: Microsoft Ignite [0:19:50]
This session explores how Microsoft Cloud services can help transform analytics data into intelligent information. Throughout this session, explore building a smart city solution with Azure IoT...
Lessons learned: Understanding Azure Data Factory pricing | THR1021
1/14/2020, YouTube: Microsoft Ignite [0:20:50]
Azure Data Factory pricing is easy, right? No upfront costs. Pay only for what you use. It's a wonderful world for developers. Just a few clicks and your solution is ready for production! But...
Building dynamic data pipelines in Azure Data Factory | BRK2103
1/14/2020, YouTube: Microsoft Ignite [0:44:44]
You already know how to build, orchestrate, and monitor data pipelines in Azure Data Factory (ADF). But how do you go from basic, hardcoded data pipelines to making your solution dynamic and...
Data Factory Expands Data Flow Parameterization Capabilities
12/16/2019, Service Updates
Azure Data Factory expands parameterization capabilities to make data flows even more reusable and scalable.
Azure Data Factory supports preserving metadata during file copy
12/12/2019, Service Updates
Azure Data Factory copy activity now supports preserving metadata during file copy among Amazon S3, Azure Blob, and Azure Data Lake Storage Gen2.
Azure Data Factory has added Avro and CosmosDB to data flows
11/11/2019, Service Updates
Azure Data Factory has added native CosmosDB and Avro connectors to mapping data flows
Transform your data with Azure Data Factory
11/5/2019, Ignite 2019 [0:45:00]
Start by creating data flows in debug mode so that you can validate your transformation logic interactively. Next, add a data flow activity to your pipeline to execute and test your data flow in...
Storing data in Azure
11/5/2019, Ignite 2019 [0:45:00]
Tailwind Traders deals with gigantic amounts of data, continually pouring in from sources such as sales, marketing, and fulfillment. In the past, the only choice they had was to put it all into a...
Back to the future: Accelerating the cloud migration of legacy SSIS with Azure Data Factory
11/5/2019, Ignite 2019 [1:15:00]
This session focuses on the new features to unblock/accelerate cloud migration of legacy SQL Server Integration Services (SSIS), such as 2008 or earlier versions, with Azure Data Factory (ADF)....