Documentation

Homepage

Overview

Overview

Azure Databricks is an Apache Spark-based analytics platform optimized for the Microsoft Azure cloud services platform. Designed with the founders of Apache Spark, Databricks is integrated with Azure to provide one-click setup, streamlined workflows, and an interactive workspace that enables collaboration between data scientists, data engineers, and business analysts.

Getting Started

Getting Started

  1. 11/15/2017, Video, 0:03:38
    Azure Databricks, a fast, easy and collaborative Apache® Spark™ based analytics platform optimized for Azure. Designed in collaboration with the founders of Apache Spark,...
  2. 5/9/2018, Video, 0:20:55
    Big Data is everywhere, and you as a developer can take advantage of the insights that can be derived of it. To make things easier, Azure brings services like Azure...
  3. 5/6/2018, Video, 1:33:22
    The developer world is changing as we create and generate new data patterns and handling processes within our applications.  Additionally, with the massive interest in machine...

Learning

Learning Paths

Data engineering with Azure Databricks
Published: 5/15/2020, Length: 10:32:00
Data engineering with Azure Databricks
Perform data science with Azure Databricks
Published: 5/22/2020, Length: 8:25:00
Perform data science with Azure Databricks
Azure Fundamentals part 2: Describe core Azure services
Published: 9/14/2020, Length: 3:12:00
This learning path provides you with an introduction to the basics of Azure's core services for compute, network, storage, and database.

Learning Modules

Work with DataFrames columns in Azure Databricks
Published: 5/15/2020, Length: 0:43:00
Integrate Azure Databricks with other Azure services
Published: 5/15/2020, Length: 0:33:00
Implement CI/CD with Azure DevOps
Published: 5/15/2020, Length: 0:28:00
Work with user-defined functions
Published: 6/4/2020, Length: 0:33:00

Azure Databricks News

11/30/2020, MS Tech Community
Most organizations are now aware of how valuable the forms (pdf, images, videos…) they keep in their closets are. They are looking for best practices and most cost-effective ways and tools to...
11/30/2020, MS Tech Community
This post is part of a multi-part series titled "Patterns with Azure Databricks".  Each highlighted pattern holds true to 3 principles for modern data analytics:     A Data Lake to store...
11/27/2020, MS Tech Community
News this week includes:   Remember it all with Microsoft To Do and Samsung Reminder   Democratizing IoT with IoT Plug and Play and New Pricing for Azure IoT Central   Azure Databricks activities...
11/25/2020, Service Updates
With this certification, customers can now use Azure Databricks to process the U.S. government’s most sensitive, unclassified data in cloud computing environments, including data that involves...
11/23/2020, MS Tech Community
As customers continue to standardize on data lakes and the Lakehouse architecture, users expect to be able to query the data in their data lake using SQL.  In fact, approximately 41% of all code...
11/23/2020, MS Tech Community
Azure Databricks supports Azure Active Directory (AAD) tokens (GA) to authenticate to REST API 2.0. The AAD tokens support enables us to provide a more secure authentication mechanism leveraging...
11/17/2020, MS Tech Community
Organizations are leveraging artificial intelligence (AI) and machine learning (ML) to derive insight and value from their data and to improve the accuracy of forecasts and predictions. In...
11/10/2020, MS Tech Community
This is a guest post by Nikhil Gupta, Partner Solutions Architect, Databricks   As customers start to move towards the lakehouse paradigm one of the necessary requirements is to have data stored...
10/28/2020, Service Updates
Azure Databricks is now available in the Swiss Azure datacenters which marks another milestone on the way to digitize Switzerland
9/30/2020, Service Updates
This new Spark CDM connector requires zero configuration and is pre-installed with Azure Synapse Analytics. It can also be installed and used with Azure Databricks.
9/23/2020, Service Updates
The COPY command can now automatically parse your files to calculate file splits and can evenly distribute data chunks across the Synapse SQL compute nodes for parallel ingestion.
9/22/2020, Service Updates
Photon powered Delta Engine is a 100% Apache Spark-compatible vectorized query engine designed to take advantage of modern CPU architecture for extremely fast parallel processing of data.
9/22/2020, Service Updates
New analytics, threat intelligence, and data collection capabilities in Azure Sentinel empower defenders to combat rapidly evolving threats with increased efficiency.
7/30/2020, Service Updates
Effective September 1, 2020 Azure Analytics Data Bricks Meters will have a name change.
To make it easier for customers to modernize their on-premises Spark and big data workloads to the cloud, we’re announcing a new migration offer with Azure Databricks.
7/10/2020, Azure Podcast
The team is joined by Stephen Wu from ADLS to talk about how the ADLS Gen 2 team is working to simplify the Storage conversation for Azure customers by driving for feature parity with Blob...
6/25/2020, Service Updates
The Azure CLI continues to expand with support for new Azure services. This release includes 23 new modules to manage as many Azure services.
6/9/2020, Service Updates
Azure Databricks is now available in preview to Azure Government customers in the US Gov Virginia and Arizona regions. Azure Databricks provides a fast, easy, and collaborative Apache...