Documentation

Homepage

Overview

Overview

In addition to pure data storage, Microsoft Azure also provides capabilities for evaluation and processing of data stored in Azure. The flexible, straightforward provision of even major compute and storage resources, which can be deactivated after data is evaluated, makes Azure the ideal environment for such additional data processing.

HD Insight enables the analysis of large data sets with the aid of Hadoop, an open source framework very popular for calculating "Big Data problems," i.e., evaluations of data sets that cannot be stored in a relational database (e.g., because they are too large or they do not have a relational structure). In these situations, Microsoft Azure makes it possible to automatically provision Hadoop VMs, distributed data and computation algorithms, etc. In addition to efficiently computing MapReduce algorithms, it also supports other concepts such as Hive and Pig.

Getting Started

Getting Started

  1. 10/3/2016, Webpage
    In HDInsight, you can work with big data in the cloud by using Hadoop, HBase, Apache Storm, and customized clusters. This learning path will help you learn Hadoop and its...
  2. 5/24/2017, Trainings
    More and more organizations are taking on the challenge of analyzing big data. This course teaches you how to use the Hadoop technologies in Microsoft Azure HDInsight to build...
  3. 5/24/2017, Trainings
    In this four week course, you’ll learn how to implement low-latency and streaming Big Data solutions using Hadoop technologies like HBase, Storm, and Spark on Microsoft Azure...
  4. 5/24/2017, Trainings
    This course is part of the Microsoft Professional Program Certificate in Data Science and part of the Microsoft Azure HDInsight Big Data Analyst XSeries. Are you ready for...
  5. 1/16/2017, Trainings
    If you’d like to learn how to architect solutions in Cortana Intelligence Suite and how to build intelligence into your applications, don’t miss this workshop! Build an...
  6. 2/10/2017, Video, 1:08:27
    With HDInsight, you can run managed Big Streaming technologies on Microsoft Azure with a rich suite of open source technologies ranging from Hadoop to Kafka to Spark, enabling...
  7. 9/28/2017, Video, 1:12:13
    Microsoft Azure provides a broad range of services for working with data. Using these services well requires knowing at least a little bit about all of them. In this session,...

Azure HDInsight News

4/27/2022, MS Tech Community
We continue to expand the Azure Marketplace ecosystem. For this volume, 118 new offers successfully met the onboarding criteria and went live. See details of the new offers below:   Get it...
3/30/2022, MS Tech Community
Spring Cloud Azure is an open-source project that provides seamless Spring integration with Azure services. It gives developers a Spring-idiomatic way to connect and consume Azure services, with...
3/11/2022, MS Tech Community
Notable Changes: Python version in Apache Spark 3.1.2 changes to 3.8. Python 2.x is no longer supported Accordingly Jupyter and Zeppelin notebook’s only support Python 3.8 from now on. This...
2/15/2022, MS Tech Community
Customers who are on Azure HDInsight 3.6 clusters will continue to get Basic support till September 30, 2022. Extension of Basic Support is provided to allow customers who have not migrated to...
1/31/2022, MS Tech Community
The most accurate way to model your use case is to simulate the load you expect on your own hardware. You can do this using the load generation tools that ship with Kafka   However, if you want...
12/15/2021, MS Tech Community
We continue to expand the Azure Marketplace ecosystem. For this volume, 126 new offers successfully met the onboarding criteria and went live. See details of the new offers below: Get...