Perform data engineering with Azure Synapse Apache Spark Pools
- Offered byMicrosoft
Perform data engineering with Azure Synapse Apache Spark Pools at Microsoft Overview
Duration | 3 hours |
Total fee | Free |
Mode of learning | Online |
Schedule type | Self paced |
Difficulty level | Intermediate |
Official Website | Explore Free Course  |
Credential | Certificate |
Perform data engineering with Azure Synapse Apache Spark Pools at Microsoft Highlights
- Learn how to transform data using DataFrames in Apache Spark Pools in Azure Synapse Analytics
- Learn how to integrate SQL and Apache Spark pools in Azure Synapse Analytics
- Learn how to monitor and manage data engineering workloads with Apache Spark in Azure Synapse Analytics
Perform data engineering with Azure Synapse Apache Spark Pools at Microsoft Course details
- Learn how to perform data engineering with Azure Synapse Apache Spark Pools
- Learn how to differentiate between Apache Spark, Azure Databricks, HDInsight, and SQL Pools
- Understanding the use-cases of data-engineering with Apache Spark in Azure Synapse Analytics
- Learn how to ingest data using Apache Spark Notebooks in Azure Synapse Analytics
Perform data engineering with Azure Synapse Apache Spark Pools at Microsoft Curriculum
Understand big data engineering with Apache Spark in Azure Synapse Analytics
Introduction
What is an Apache Spark pool in Azure Synapse Analytics
How do Apache Spark pools work in Azure Synapse Analytics
When do you use Apache Spark pools in Azure Synapse Analytics
Knowledge check
Summary
Ingest data with Apache Spark notebooks in Azure Synapse Analytics
Introduction
Introduction to spark notebooks
Understand the use-cases for spark notebooks
Exercise: Create a spark notebook in Azure Synapse Analytics
Discover supported languages in spark notebooks
Develop spark notebooks
Exercise: Develop spark notebook
Run spark notebooks
Exercise: Run spark notebooks
Load data in spark notebooks
Exercise: Load data in spark notebooks
Save spark notebooks
Knowledge check
Summary
Transform data with DataFrames in Apache Spark Pools in Azure Synapse Analytics
Introduction
Introduction to dataframes in spark pools in Azure Synapse Analytics
Load data into a spark dataframe
Exercise: Load data into a spark dataframe
Exercise: Create a spark table
Flatten nested structures and explode arrays with Apache Spark
Exercise: Flatten nested structures and explode arrays with Apache Spark in synapse
Knowledge check
Summary
Integrate SQL and Apache Spark pools in Azure Synapse Analytics
Introduction
Describe the integration methods between SQL and spark pools in Azure Synapse Analytics
Understand the use-cases for SQL and spark pools integration
Authenticate in Azure Synapse Analytics
Transfer data between SQL and spark pool in Azure Synapse Analytics
Authenticate between spark and SQL pool in Azure Synapse Analytics
Exercise: Integrate SQL and spark pools in Azure Synapse Analytics
Externalize the use of spark pools within Azure Synapse Workspace
Transfer data outside the synapse workspace using the PySpark connector
Knowledge check
Summary
Perform data engineering with Azure Synapse Apache Spark Pools at Microsoft Entry Requirements
- Prerequisites: It is recommended that students have completed Data Fundamentals
- Not mentioned
Other courses offered by Microsoft
Student Forum
Anything you would want to ask experts?
Data ScienceData Science BasicsData ManagementPerform data engineering with Azure Synapse Apache Spark Pools