Monitor and manage data engineering workloads with Apache Spark in Azure Synapse Analytics
Learn how to monitor and manage data engineering workloads with Apache Spark in Azure Synapse Analytics.
Learning objectives
After completing this module, you will be able to:
- Monitor Spark Pools in Azure Synapse Analytics
- Understand Resource Utilization of Spark Pools in Azure Synapse Analytics
- Monitor Query activity of Spark Pools in Azure Synapse Analytics
- Base-line Apache Spark performance with Apache Spark History Server in Azure Synapse Analytics
- Optimize Apache Spark jobs in Azure Synapse Analytics
- Automate scaling of Apache Spark pools in Azure Synapse Analytics
Prerequisites
Before taking this module, it is recommended that you complete the following modules:
- Data Fundamentals
- Introduction to Azure Data Factory
- Introduction to Azure Synapse Analytics