Azure Data Factory For Azure Data Engineer And Dp-203 Exam

Data engineering with Azure Data Factory in real world projects in 1.5 hours. Start your career as Azure Data engineer !

What you'll learn
Data engineering with Azure data factory in real world projects to process large scale data
Data movement and migration using copy data activity from various sources
Data transformations and processing using Data flow activity
Creating linked services to connect with various data sources
Creating Integration runtime to run the ADF pipeline
Implementing different types of triggers in Azure Data Factory
Data monitoring and and alerts in Azure Data factory
Requirements
There are no prerequisites for this course. No programming experience is required
It is good to have basic knowledge of ETL tools but not compulsory
It is good to have some knowledge in SQL but not mandatory
Every one is able to understand this course
Description
In this course, you are going to learn how to build data pipelines with azure data factory for real-world projects from an industry expert with hands-on Labs.Anyone can spend 1.5 hours time and become an Azure Data engineer!This course will provide what is data factory, what are the various core components in azure data factory.This course is useful for those aspiring to become azure data engineers. Those who want to switch their career from soft engineering to data engineerTo expand their skills from AWS, GCP data engineer to AZURE data engineerto gain an in-depth understanding of the latest trends in azure data engineeringThis course covers the following topics.Basic concepts of various components in ADFWhat are ETL and ELT What is Linked service, Demo for creating Linked serviceWhat is a data set, Demo for creating Data setWhat is Integration run timeWhat is an Azure Data lake Demo for creating Azure data lake storage accountWhat is Cosmos DBDemo for creating Cosmos DBWhat is COPY activityDemo for creating a data pipeline to move data from ADLS 2 to Cosmos DB using COPY ActivityWhat are control flow activities- Get Metadata activityDemo for getting Metadata activityFilter activityDemo for Filter activityForEach activityDemo for  ForEach activityDemo for other Control flow activitiesWhat is DATA FLOW ActivityDemo for removing Duplicate data using DATA FLOW ActivityThe course is useful not only for freshers but also for experienced data engineers to gain more skills in azure data engineering

Overview

Section 1: Introduction

Lecture 1 What is Azure Data Factory and real world usecases

Section 2: Data engineering with ADF

Lecture 2 Data engineering Patterns using ADF

Section 3: Data Pipeline components in ADF

Lecture 3 Pipeline,Activities, Integration Runtime, Datasets and Linked Services

Lecture 4 Demo: Creating a storage account

Lecture 5 Demo: Creating a Cosmos DB account

Lecture 6 Demo: Creating a Dataset in Azure Data Factory

Lecture 7 Demo: Creating a Linked Service in Azure Data Factory

Lecture 8 Demo:ADF DS to Cosmos db

Lecture 9 Demo:ADF to Cosmos DB linked service

Lecture 10 Demo: Creating Data pipeline using COPY activity

Section 4: Control Flow and Data Flow activities

Lecture 11 Demo: Control flow activities -Metadata activity , Filter and ForEach activity

Lecture 12 Demo: Data flow activity for de-duplication and aggregation

Section 5: Triggers and Monitoring

Lecture 13 Types of Integration runtimes

Lecture 14 Demo: Create Azure Integration runtime

Lecture 15 Types of triggers

Lecture 16 Demo: On-demand trigger

Lecture 17 Demo: Monitoring the ADF pipeline

This course is useful for anyone aspiring to become data engineer,Those who started their journey as data engineer to learn more advanced concepts,Those who want to switch their career from any other software to data engineering,For practicing data engineers to get more insights on real world data pipelines design,Those who wants to optimize and improve the performance of data pipelines to process large scale data,This course is for every one including freshers and people shifting their career to IT field.