Azure Data Factory: A Complete Guide

Learn to create pipelines in Azure Data Factory

What you'll learn

Create Pipelines on Azure Data Factory

Learn to use variables , parameters and complex pipelines

Schedule Pipeline using Triggers

End to end project on Azure Data Factory

Requirements

There is no prerequisite for this course

Description

Welcome to the Azure Data Factory Course.Key highlights of the course are below:This course covers topics from basics to advanced.Most used activities added.Advance topics like variables ,parameters ,expressions added.Schedule pipeline using triggers.Most used data flow transformations added.Debugging and Troubleshooting pipelines.Monitor pipeline.Send alerts from pipeline to Microsoft Teams channel.Interview questions were added to help prepare for the interview.Frequently added and updated courses as Microsoft release new updates on the product.Real-time pipeline examples are given.This course will also help you in your Azure Data Engineering career.A quiz is available to check your knowledge.Who should take this course:Anyone interested to start a cloud journey.Students want to start a career in Azure Data Engineering.Freshers interested in Data Engineering.Professionals with On-premises ETL knowledge. Data Professionals wants to learn advance topics in Azure Data Factory.Anyone wants to crack ETL or ADF interview.Data Scientist interested in Data Engineering topics.Cloud professionals wants to completed Azure certifications such as DP-900 and DP-203.Prerequisite:There is no prior knowledge required for this course. However, if you have knowledge of the basics of SQL it will help you understand quickly.

Overview

Section 1: Introduction

Lecture 1 Introduction

Lecture 2 What is Azure Data Factory?

Lecture 3 Create an Azure Data Factory Service

Lecture 4 Key Components in Data Factory

Lecture 5 Create your first pipeline

Section 2: Getting started with Azure Data Factory

Lecture 6 Pipeline

Lecture 7 Activities

Lecture 8 Linked Services

Lecture 9 ADF Portal

Section 3: Most Used Activities

Lecture 10 Copy Data Activity

Lecture 11 Data Flows

Lecture 12 Lookup Activity

Lecture 13 Append Variable Activity

Lecture 14 Set Variable Activity

Lecture 15 Stored Procedure Activity

Lecture 16 Execute Pipeline Activity

Lecture 17 Filter Activity

Lecture 18 ForEach Activity

Lecture 19 If Activity

Lecture 20 Switch Activity

Lecture 21 Until Activity

Section 4: Data Flow Transformations

Lecture 22 Flatten Transformations

Lecture 23 Aggregate Transformations

Lecture 24 Derived Column Transformations

Lecture 25 Aggregate Transformations

Lecture 26 Conditional Split Transformations

Lecture 27 Surrogate Key Transformations

Section 5: Enhancing Pipeline Features

Lecture 28 Parameters

Lecture 29 Variables

Lecture 30 Triggers

Lecture 31 Templates

Section 6: Pipelines by example

Lecture 32 Merge multiple files to a single file

Lecture 33 Sending Alerts to Microsoft Teams

Data Engineer,SQL Developer wants to know about Data Factory,Data Analyst curious about Data Pipeline