Microsoft
Microsoft Logo

Data integration at scale with Azure Data Factory or Azure Synapse Pipeline 

  • Offered byMicrosoft

Data integration at scale with Azure Data Factory or Azure Synapse Pipeline
 at 
Microsoft 
Overview

Learn how to create and manage data pipelines in the cloud using Azure Data Factory

Duration

6 hours

Total fee

Free

Mode of learning

Online

Schedule type

Self paced

Difficulty level

Intermediate

Official Website

Explore Free Course External Link Icon

Credential

Certificate

Data integration at scale with Azure Data Factory or Azure Synapse Pipeline
 at 
Microsoft 
Highlights

  • Learn how you can publish your Azure Data Factory work between different environments
  • Learn how to ingest data from Azure Data Share into Azure Data Factory pipelines to build automated ingestion pipelines
  • Learn how to implement Slowly Changing Dimension using Azure Data Factory
Details Icon

Data integration at scale with Azure Data Factory or Azure Synapse Pipeline
 at 
Microsoft 
Course details

Skills you will learn
What are the course deliverables?
  • Integrate data with Azure Data Factory or Azure Synapse Pipeline
  • Petabyte-scale ingestion with Azure Data Factory or Azure Synapse Pipeline
  • Perform code-free transformation at scale with Azure Data Factory or Azure Synapse Pipeline
  • Populate slowly changing dimensions in Azure Synapse Analytics pipelines
  • Orchestrate data movement and transformation in Azure Data Factory or Azure Synapse Pipeline
  • Execute existing SSIS packages in Azure Data Factory or Azure Synapse Pipeline
  • Operationalize your Azure Data Factory or Azure Synapse Pipeline
  • Send and receive data using Azure Data Share and transform data using Azure Data Factory
More about this course
  • Examine Azure Data Factory and the core components
  • Learn the various methods that can be used to ingest data between various data stores using Azure Data Factory
  • Know how to perform common data transformation and cleansing activities within Azure Data Factory without using code
  • Learn how you can integrate SQL Server Integration Services packages into an Azure Data Factory solution

Data integration at scale with Azure Data Factory or Azure Synapse Pipeline
 at 
Microsoft 
Curriculum

MODULE:1 Integrate data with Azure Data Factory or Azure Synapse Pipeline

Understand Azure Data Factory

Describe data integration patterns

Explain the data factory process

Understand Azure Data Factory components

Azure Data Factory security

Set-up Azure Data Factory

Create linked services

Create datasets

Create data factory activities and pipelines

Manage integration runtimes

MODULE:2 Petabyte-scale ingestion with Azure Data Factory or Azure Synapse Pipeline

List the data factory ingestion methods

Describe data factory connectors

Use the data factory copy activity

Manage the self-hosted integration runtime

Set up the Azure integration runtime

Understand data ingestion security considerations

MODULE:3 Perform code-free transformation at scale with Azure Data Factory or Azure Synapse Pipeline

Explain Azure Data Factory transformation methods

Describe Azure Data Factory transformation types

Author an Azure Data Factory mapping data flow

Debug mapping data flow

Use Azure Data Factory wrangling data

Use compute transformations within Azure Data Factory

Integrate SQL server integration services packages within Azure Data Factory

MODULE:4 Populate slowly changing dimensions in Azure Synapse Analytics pipelines

Describe slowly changing dimensions

Choose between slowly changing dimension types

Exercise - Design and implement a Type 1 slowly changing dimension with mapping data flows

MODULE:5 Orchestrate data movement and transformation in Azure Data Factory or Azure Synapse Pipeline

Understand data factory control flow

Work with data factory pipelines

Debug data factory pipelines

Add parameters to data factory components

Exercise - Integrate a Notebook within Azure Synapse Pipelines

Execute data factory packages

MODULE:6 Execute existing SSIS packages in Azure Data Factory or Azure Synapse Pipeline

Describe SQL Server integration services

Understand the Azure SSIS Integration Runtime

Set-up Azure SSIS Integration Runtime

Run SSIS packages in Azure Data Factory

Migrate SSIS packages to Azure Data Factory

MODULE:7 Operationalize your Azure Data Factory or Azure Synapse Pipeline

Understand the language support in Azure Data Factory

Manage source control of Azure Data Factory solutions

Continuous integration and deployment

Monitor Azure Data Factory pipelines

Set up alerts for Azure Data Factory

Rerun Azure Data Factory pipelines

MODULE:8 Send and receive data using Azure Data Share and transform data using Azure Data Factory

Send and Receive data using Azure Data Share and transform data using Azure Data Factory

Exercise: Share and receive data using Azure Data Share and transform data using Azure Data Factory

Ingest data into Azure Data Lake Gen 2 using Azure Data Factory

Exercise: Ingest data into Azure Data Lake Storage Gen 2 with Azure Data Factory

Join and transform shared and owned data with Mapping Flow in Azure Data Factory

Exercise: Join and transform shared and current dataset with Mapping Flow in Azure Data Factory

Sink dataset into Azure Synapse Analytics using Azure Data Factory

Exercise: Sink dataset into Azure Synapse Analytics with Azure Data Factory

Publish a pipeline run in Azure Data Factory

Exercise: Publish a pipeline run in Azure Data Factory

Other courses offered by Microsoft

Free
2 hours
Intermediate
Free
4 hours
Intermediate
Free
5 hours
Beginner
Free
1 hours
Beginner
View Other 1171 CoursesRight Arrow Icon
qna

Data integration at scale with Azure Data Factory or Azure Synapse Pipeline
 at 
Microsoft 

Student Forum

chatAnything you would want to ask experts?
Write here...