Use Apache Flink on Azure HDInsight on AKS

Module
7 Units

Beginner

Administrator

Database Administrator

Data Engineer

Data Scientist

Azure

HDInsight on AKS

This tutorial guides you through the process of performing streaming data transformations using Apache Flink on HDInsight on AKS deployed on Azure Kubernetes Service(AKS). It covers setting up the environment, deploying Apache Flink on HDInsight on AKS, configuring data sources and sinks, and executing streaming data transformations efficiently.

Learning objectives

By the end of this module, you can

Understand Apache Flink architecture and use cases
Create and configure an Apache Flink cluster
Run an Apache Flink Job from the portal, Apache Flink UI, web ssh pod and REST API
Integrate Apache Flink and Apache Kafka.

Prerequisites

Good working experience with Azure
Good working experience with big data platforms
Before starting, you should complete the modules:
- Introduction to Azure HDInsight on AKS
- Configure and manage HDInsight on AKS Cluster.

Introduction min
Apache Flink architecture min
Create an Apache Flink cluster min
Run your first job in Apache Flink min
Write event messages into Azure Data Lake Storage Gen2 with an Apache Flink on HDInsight on AKS min
Knowledge check min
Summary min