Data integration at scale with Azure Data Factory or Azure Synapse Pipeline
- Offered byMicrosoft
Data integration at scale with Azure Data Factory or Azure Synapse Pipeline at Microsoft Overview
Duration | 6 hours |
Total fee | Free |
Mode of learning | Online |
Schedule type | Self paced |
Difficulty level | Intermediate |
Official Website | Explore Free Course |
Credential | Certificate |
Data integration at scale with Azure Data Factory or Azure Synapse Pipeline at Microsoft Highlights
- Learn how you can publish your Azure Data Factory work between different environments
- Learn how to ingest data from Azure Data Share into Azure Data Factory pipelines to build automated ingestion pipelines
- Learn how to implement Slowly Changing Dimension using Azure Data Factory
Data integration at scale with Azure Data Factory or Azure Synapse Pipeline at Microsoft Course details
- Integrate data with Azure Data Factory or Azure Synapse Pipeline
- Petabyte-scale ingestion with Azure Data Factory or Azure Synapse Pipeline
- Perform code-free transformation at scale with Azure Data Factory or Azure Synapse Pipeline
- Populate slowly changing dimensions in Azure Synapse Analytics pipelines
- Orchestrate data movement and transformation in Azure Data Factory or Azure Synapse Pipeline
- Execute existing SSIS packages in Azure Data Factory or Azure Synapse Pipeline
- Operationalize your Azure Data Factory or Azure Synapse Pipeline
- Send and receive data using Azure Data Share and transform data using Azure Data Factory
- Examine Azure Data Factory and the core components
- Learn the various methods that can be used to ingest data between various data stores using Azure Data Factory
- Know how to perform common data transformation and cleansing activities within Azure Data Factory without using code
- Learn how you can integrate SQL Server Integration Services packages into an Azure Data Factory solution
Data integration at scale with Azure Data Factory or Azure Synapse Pipeline at Microsoft Curriculum
MODULE:1 Integrate data with Azure Data Factory or Azure Synapse Pipeline
Understand Azure Data Factory
Describe data integration patterns
Explain the data factory process
Understand Azure Data Factory components
Azure Data Factory security
Set-up Azure Data Factory
Create linked services
Create datasets
Create data factory activities and pipelines
Manage integration runtimes
MODULE:2 Petabyte-scale ingestion with Azure Data Factory or Azure Synapse Pipeline
List the data factory ingestion methods
Describe data factory connectors
Use the data factory copy activity
Manage the self-hosted integration runtime
Set up the Azure integration runtime
Understand data ingestion security considerations
MODULE:3 Perform code-free transformation at scale with Azure Data Factory or Azure Synapse Pipeline
Explain Azure Data Factory transformation methods
Describe Azure Data Factory transformation types
Author an Azure Data Factory mapping data flow
Debug mapping data flow
Use Azure Data Factory wrangling data
Use compute transformations within Azure Data Factory
Integrate SQL server integration services packages within Azure Data Factory
MODULE:4 Populate slowly changing dimensions in Azure Synapse Analytics pipelines
Describe slowly changing dimensions
Choose between slowly changing dimension types
Exercise - Design and implement a Type 1 slowly changing dimension with mapping data flows
MODULE:5 Orchestrate data movement and transformation in Azure Data Factory or Azure Synapse Pipeline
Understand data factory control flow
Work with data factory pipelines
Debug data factory pipelines
Add parameters to data factory components
Exercise - Integrate a Notebook within Azure Synapse Pipelines
Execute data factory packages
MODULE:6 Execute existing SSIS packages in Azure Data Factory or Azure Synapse Pipeline
Describe SQL Server integration services
Understand the Azure SSIS Integration Runtime
Set-up Azure SSIS Integration Runtime
Run SSIS packages in Azure Data Factory
Migrate SSIS packages to Azure Data Factory
MODULE:7 Operationalize your Azure Data Factory or Azure Synapse Pipeline
Understand the language support in Azure Data Factory
Manage source control of Azure Data Factory solutions
Continuous integration and deployment
Monitor Azure Data Factory pipelines
Set up alerts for Azure Data Factory
Rerun Azure Data Factory pipelines
MODULE:8 Send and receive data using Azure Data Share and transform data using Azure Data Factory
Send and Receive data using Azure Data Share and transform data using Azure Data Factory
Exercise: Share and receive data using Azure Data Share and transform data using Azure Data Factory
Ingest data into Azure Data Lake Gen 2 using Azure Data Factory
Exercise: Ingest data into Azure Data Lake Storage Gen 2 with Azure Data Factory
Join and transform shared and owned data with Mapping Flow in Azure Data Factory
Exercise: Join and transform shared and current dataset with Mapping Flow in Azure Data Factory
Sink dataset into Azure Synapse Analytics using Azure Data Factory
Exercise: Sink dataset into Azure Synapse Analytics with Azure Data Factory
Publish a pipeline run in Azure Data Factory
Exercise: Publish a pipeline run in Azure Data Factory