Azure Data Factory : from Zero to Hero of Azure Data Factory
- Offered byUDEMY
Azure Data Factory : from Zero to Hero of Azure Data Factory at UDEMY Overview
Duration | 11 hours |
Total fee | ₹389 |
Mode of learning | Online |
Credential | Certificate |
Azure Data Factory : from Zero to Hero of Azure Data Factory at UDEMY Highlights
- Earn a certificate of completion from Udemy
- Comes up with 30-Day Money-Back Guarantee
- Get Full lifetime access
Azure Data Factory : from Zero to Hero of Azure Data Factory at UDEMY Course details
- For College / University Students looking for a career in Data Engineering
- For Freshers interested in Data Engineering on Microsoft Azure
- For Mid Level Data Engineering, Data Integration, ETL Developers
- For Data Engineers/ Data Warehouse Developers currently working on on-premises technologies, or other cloud platforms such as AWS or GCP who want to learn Azure Technologies
- For Professionals willing to do Microsoft Certifications such as DP-900, DP-203 etc
- For Mid Level Professionals who wants to learn Azure & Data Engineering
- For Experienced Professionals willing to master Azure Data Factory
- For Experienced Professionals willing to be Architect in order to understand capability of Data Factory
- For Data Scientists who want extend their knowledge into data engineering
- Real World Use Cases will detailed solutions
- Create Data driven, fully integrated, dynamic and automated production grade pipeline creation and orchestration
- Data Warehousing Concepts like Fact & dimension tables, SCD type1, type2, Incremental loading and implement using ADF
- All the topics related to Azure Data Factory in DP 203, DP 900 certification are covered in this course.
- Connect & copy data from On Premise data stores, On premise SQL server via Self Hosted Integration Runtime to cloud
- Gain good Data Engineering skills in Azure using Azure Data Factory (ADF), Azure Data Lake Gen2, Azure SQL Database, Azure Blob Storage and REST API
- Covers most frequently used data sources such as Azure Blob, Azure Data Lake Gen2, Azure SQL DB, REST API, On Premise Database, On Premise Virtual Machines etc
- Building a solution architecture for a data engineering solution using Azure Data Engineering technologies such as Spark based Azure Data Factory (ADF), Azure Data Lake Gen2, Azure Blob Storage, Azure SQL Database, On Premise Database, On Premise Virtual Machines and RESTful API
- Covers different types of Triggers, scheduling and their application in details. Trigger dependencies and pipeline chaining also covered
Azure Data Factory : from Zero to Hero of Azure Data Factory at UDEMY Curriculum
Introduction
Promo
Course Structure
What is Cloud Computing?
What is Azure Data Factory?
Environment Setup
Module Overview
Create Azure Account
Azure Portal Walkthrough
Create storage account
Bonus - Storage Account Redundancy Options
Bonus - Storage Account Access Tier
Create Azure DataLake Gen2 account
Create Azure Data Factory
Create Azure SQL DB
Create SQL Server VM
Building Blocks of Azure Data Factory
ADF Building Blocks Overview
Pipelines
Activities
Linked Services
DataSets
Supported File Formats
Triggers
Interaction between different components
Copy Data Activity
Copy Data from Blob to ADLS
Copy Data - Logging settings
Copy Data - Multiple files from a folder & other settings
Copy Data - Last modified filter
RWS #3: Append Filename Column during copy
Copy data from Azure SQL Tables
Copy Data - Fault tolerance
Setting up self hosted IR
Copy data from On prem DB
Delete SQL Server VM
Copy Data from REST API
Parameters & Variables
Parameterized componenets
Variables in Azure Data Factory
System Variables
Set Variable Activity
Control Flow Activities
Filter
For each
Lookup
RWS #2: Copy Multiple Files in bulk using lookup table - Usecase & Hints
Get metadata
RWS #1 : Copy files that are modified in last one day - Usecase & Hints
if condition
Wait
Switch
Validation