Microsoft Fabric: Practical Hands-On Project Course

Step-by-Step BI Project-Based Course on real use case Master Data Warehousing, Processing and Integration with Fabric

What you'll learn

Set Up Data Ingestion In Fabric using different methods Pipelines, Dataflows Gen 2 and Pyspark Notebooks

Clean and Transform Data : Set up data flows in Data Factory to clean and transform the raw data. Apply filters and remove duplicates as necessary.

Aggregate and Process Data: Create additional data flows or Stored Proc to aggregate and process the cleaned data. Store the processed data in the GoldenDWH.

Prepare Data for Reporting: Prepare the final dataset for the Power BI report, optimizing it for performance. Use the Gold Layer data to create the BI reports

Automate the Workflow: Schedule the data pipelines to run daily. Set up triggers and alerts in Data Factory to notify stakeholders via email about the pipeline

Configure Access Control Implement role-based access control (RBAC) to manage access to each layer of the medallion architecture.

Requirements

Basic Knowledge of Fabric

Description

Get ready to dive into the practical aspects of data management with Fabric in this hands-on, project-based course. Designed for data professionals and engineers, this course walks you through real-world scenarios, focusing on a use case scenario frequently encountered when working with Microsoft Fabric What you'll learn:Creating and Managing Data Warehouses: Learn how to set up Bronze, Silver, and Gold data warehouses in Fabric.Create a modern Lakehouse architecture: Medallion architecture Automating Data Refresh: Master the creation and execution of stored procedures to automate data refreshes.View and Table Management: Understand how to create, drop, and manage views and tables efficiently.Learn about the semantic models in MS FabricPower BI Integration: Link your data warehouse to Power BI, and create dynamic reports and dashboards.Troubleshooting Common Issues: Gain the skills to troubleshoot and resolve common data management challenges.Who this course is for:Data Analysts and Business Intelligence Professionals looking to enhance their practical skills with Fabric.IT Professionals responsible for managing data warehouses.Anyone interested in learning how to manage data efficiently and create dynamic reports with Power BI.Course Features:Step-by-Step Instructions: Follow along with detailed steps to set up and manage your data warehouse.Real-World Example: Engage with practical examples and tasks based on real-world scenarios.Interactive Projects: Apply what you learn through interactive projects that simulate actual data management tasks.Resources and Support: Access supplemental resources and get support to help you succeed in your learning journey.

Overview

Section 1: Quick Introduction Microsoft Fabric ( Optional if you Already know Fabric)

Lecture 1 Welcome and Course Overview

Lecture 2 Introduction to Microsoft Fabric

Lecture 3 Setting Up Your Fabric Environment

Lecture 4 Set up Fabric Environment without work email

Lecture 5 Explore MS Fabric Interface and create the workspace

Section 2: ETL - Data Ingestion

Lecture 6 Welcome to Section 2 of this course

Lecture 7 Introduction to ETL/ ELT processes

Lecture 8 Medallion architecture overview

Lecture 9 Explain the requirements and acceptance criteria of the project

Lecture 10 Explore existing Power Bi reports the Data model and the excel sheets used

Lecture 11 Create the medallion architecture in Fabric using lakehouse and datawarehouses

Lecture 12 Create a New semantic model instead of the default one

Lecture 13 Install SSMS, SQL Server and Restore the Adventure works Database

Lecture 14 Install Fabric Gateway to connect On - Prem SQL server to the cloud

Lecture 15 Connect to SQL server data source and import data - Method 1 : Dataflow Gen 2

Lecture 16 Troubleshooting common errors that might occur in this step

Lecture 17 Connect to and import data - Method 2: Data Factory Pipeline (Optional)

Lecture 18 Ingest Data from Onprem Excel worksheets to Bronze Lakehouse tables

Lecture 19 Explore the Data in Bronze Lakehouse

Section 3: ETL - Data Transformation and Loading

Lecture 20 Welcome to Section 3

Lecture 21 Data movement from Bronze Lakehouse to Silver DWH - Method 1: Data flow Gen 2

Lecture 22 Transform the Data from Bronze to Silver - Method 2: Stored procedure

Lecture 23 Create The Silver Datawarehouse views that joins and clean the Data

Lecture 24 Prepare data for reporting : Create GoldDWH tables

Lecture 25 Data Quality Frameworks

Lecture 26 Prepare the Gold semantic model

Lecture 27 Create Data model Entities relationship

Section 4: Power BI Integration, Reporting and Automation

Lecture 28 Introduction to Section 4

Lecture 29 Automate data workflows, Set up triggers

Lecture 30 Connect Power BI to Semantic Model - Measure -Calculated column and Date Table

Lecture 31 Creating Power BI Reports in Fabric

Lecture 32 Create a power Bi report for Orders Analysis

Section 5: Additional Lectures

Lecture 33 Introduction to DAX

Lecture 34 The usage metrics report

Lecture 35 Thoughts on Microsoft Fabric for Data Warehousing and Analytics

Lecture 36 Known issues about Fabric- August 2024

Data engineers,Data Analysts,Data Architects,Power Bi developers,BI developers,Students in data related fields