Become A Data Warehouse Engineer - (Dw,Sql,Etl/Ssis,Azure)

Practical Data Warehousing: Data Warehouse Design,Azure Synapse, ETL, Ingesting and Consuming Data in a Data Warehouse

What you'll learn

Provision a dedicated SQL Pool for data warehouse

Provision Azure Synapse Analytics workspace

Ingest data with a pipeline

Use a Serverless SQL Pool to analyse data

Visualize data with Synapse Studio

Data Warehouse Design

Configure Database Settings for Data Warehouse

Designing Dimension Tables

Create an ETL Solutions with SSIS

Implement data flow

Debug SSIS Package

Implement Incremental ETL Process

SSIS Configuration and Deployment

Enforce Data Quality in a Data Warehouse

Consume Data in a Data Warehouse

Requirements

Basic knowledge of Database Concepts advised

Required Software will be covered in the course.

Description

This  course is  designed to equip you with an understanding of Data Warehousing concepts and practices, SQL programming, ETL processes using SQL Server Integration Services (SSIS), and Azure Synapse Analytics. This course aims to provide you with both theoretical knowledge and practical skills to become a proficient Data Warehouse Engineer.As a part of this course, you will learn how to provision a dedicated SQL Pool for data warehouse use, critical for managing and running large scale analytical processing. You will also get hands-on experience in provisioning Azure Synapse Analytics workspace, Microsoft's integrated analytics service that accelerates your time to insight across data warehouses and big data systems.The course will guide you through designing and building data ingestion systems using a pipeline. You will acquire practical skills on using a Serverless SQL Pool to analyze data, providing you the ability to query data on-demand with no infrastructure setup.You will learn to effectively structure your data warehouse for optimal data retrieval and analysis. This includes learning how to configure database settings for a data warehouse and designing dimension tables - crucial aspects of building a functional, efficient data warehouse.You will also dive deep into creating robust ETL solutions with SSIS, allowing you to manage and automate your data transformation processes. This includes learning to implement data flows, debug SSIS packages, and understand how to implement an incremental ETL process, keeping your data warehouse up-to-date without overloading your systems.The course covers SSIS configuration and deployment, enabling you to effectively manage your ETL solutions in different environments. Ensuring data quality is a crucial aspect of any data warehouse system. You will learn strategies to enforce data quality in a data warehouse, ensuring reliable and accurate insights from your data.Lastly, the course will also train you on how to consume data in a data warehouse. This involves not just extracting data, but also transforming it into useful insights and visualizations, which you will learn to create using Synapse Studio.By the end of this course, you will have a solid foundation in data warehouse engineering, and be ready to take on roles in this exciting and growing field.

Overview

Section 1: Introduction to Data Warehouse

Lecture 1 Introduction

Lecture 2 What is a Data Warehouse

Lecture 3 Database vs Data Warehouse

Lecture 4 Standard Data Warehouse Vs Enterprise Data Warehouse

Lecture 5 Pro and cons of an SQL Server Data Warehouse

Lecture 6 Data warehousing concepts

Lecture 7 Data Warehousing Architecture

Lecture 8 Data Warehousing Tools

Lecture 9 Data Warehouse best practices

Section 2: Microsoft SQL Server Setup

Lecture 10 What is SQL Server

Lecture 11 SQL Server Editions

Lecture 12 Please Read

Lecture 13 Microsoft SQL Server Installation Requirements

Lecture 14 Download SQL Server

Lecture 15 Install SQL Server

Lecture 16 Install SQL Server Management Studio - SSMS

Lecture 17 Connect SSMS to SQL Server

Lecture 18 Note on Databases

Lecture 19 Restoring Sample Data Warehouse Database

Section 3: SQL Server Data Warehouse Configurations

Lecture 20 Hardware requirements for Data Warehouse

Lecture 21 Enable SQL Server Agent

Lecture 22 Configure Database Settings for Data Warehouse

Section 4: Data Warehouse Design

Lecture 23 Logical Data Warehouse Design

Lecture 24 Physical Data Warehouse Design - Part 1

Lecture 25 Physical Data Warehouse Design - Part 2

Lecture 26 Designing Dimension Tables

Section 5: Visual Studio Setup

Lecture 27 What is Visual Studio

Lecture 28 Visual Studio Installation Requirements

Lecture 29 Installing Visual Studio

Lecture 30 Download SQL Server Data Tools (SSDT) for Visual Studio

Lecture 31 Installing SQL Server Data Tools - SSDT

Lecture 32 Install SSDT Extensions

Section 6: Creating an ETL Solutions with SSIS

Lecture 33 What is ETL

Lecture 34 What is SSIS

Lecture 35 Introduction to ETL with SSIS

Lecture 36 Creating a new SSIS Project

Lecture 37 Exploring data source: Part 1

Lecture 38 Exploring data source: Part 2

Lecture 39 Introduction to control flow - Part 1

Lecture 40 Introduction to control flow - Part 2

Lecture 41 Implementing data flow - Part 1

Lecture 42 Implementing data flow - Part 2

Lecture 43 Debugging SSIS Package - Part 1

Lecture 44 Debugging SSIS Package - Part 2

Lecture 45 Logging SSIS Package Events

Lecture 46 Handling errors in an SSIS Package

Section 7: Implementing Incremental ETL Process

Lecture 47 Introduction to incremental ETL Process

Lecture 48 Extracting modified data - Part 1

Lecture 49 Extracting modified data - Part 2

Lecture 50 Extracting modified data - Part 3

Lecture 51 Extracting modified data - Part 4

Lecture 52 Loading modified data - Part 1

Lecture 53 Loading modified data - Part 2

Lecture 54 Working with changing dimensions

Section 8: SSIS Configuration and Deployment

Lecture 55 Integration services catalogs

Lecture 56 Deploying SSIS Solutions

Lecture 57 Execute a package with SQL Server Agent

Lecture 58 Configuring advanced SSIS Settings

Section 9: Enforcing Data Quality in a Data Warehouse

Lecture 59 Enforcing Data Quality

Lecture 60 Installing Data Quality Services

Lecture 61 Cleansing data with data quality services

Lecture 62 Detecting duplicate data: Part 1

Lecture 63 Detecting duplicate data: Part 2

Lecture 64 Using Data Quality Services in SSIS Data Flow

Section 10: Consuming Data in a Data Warehouse

Lecture 65 Consuming Data

Lecture 66 Introduction to Business Intelligence

Lecture 67 Creating a new SSRS Project

Lecture 68 Using SSRS in Data Warehouse - Part 1

Lecture 69 Using SSRS in Data Warehouse - Part 2

Lecture 70 Creating a new SSAS Project

Lecture 71 Data Analysis with SSAS - Part 1

Lecture 72 Data Analysis with SSAS - Part 2

Lecture 73 Using Ad-hoc SQL/T-SQL Queries

Section 11: Azure Data Warehouse

Lecture 74 What is Azure

Lecture 75 Create a free Azure Subscription Account

Lecture 76 How to access Azure Services

Lecture 77 What is Azure Synapse Analytics

Lecture 78 When to use Azure Synapse Analytics

Lecture 79 Common types of analytical techniques

Lecture 80 What is a dedicated SQL Pool

Lecture 81 Provision a dedicated SQL Pool for data warehouse

Lecture 82 Provision Azure Synapse Analytics workspace

Lecture 83 Explore Synapse Studio

Lecture 84 Ingest data with a pipeline

Lecture 85 Use a Serverless SQL Pool to analyse data

Lecture 86 Visualizing data with Synapse Studio

Beginner Data Warehouse Engineers,Beginner Data Warehouse Developers,Beginner Data Analyst,Beginner Data Engineers,Beginner Data Science