Build Data Lake House For Retail Store

Learn Databricks concepts, Spark, Spark Structure Streaming, Delta lake, Databricks SQL Analytics

What you'll learn

Azure Databricks Fundamentals

Delta Lake Fundamentals

Learn Bronze Layer,Silver layer & Gold layer

Learn Workflow

Requirements

Python & Spark

Description

Learn Databricks concepts, PySpark, Spark Structure Streaming, Delta lake, Databricks SQL Analytics.Learn Bronze Layer.Learn Silver Layer.Learn Gold LayerLearn Databricks concepts, PySpark, Spark Structure Streaming, Delta lake, Databricks SQL Analytics.Learn Bronze Layer.Learn Silver Layer.Learn Gold LayerLearn Databricks concepts, PySpark, Spark Structure Streaming, Delta lake, Databricks SQL Analytics.Learn Bronze Layer.Learn Silver Layer.Learn Gold LayerModule 1:•Setup Azure Account•Setup Workspace•Navigate the Workspace•Clusters•What is Notebook•What is Libraries•Databricks File System (DBFS)•DBUTILS•WidgetsModule 2:•What Is Data Lakehouse•Delta Lake•Create Delta Table•Read & Write Delta Table•Update / Delete / Merge•Schema Validation•Time Travel•Generated ColumnsModule 3:•Configure Data Source•Build Product Pipeline•Build Customer Pipeline•Build Order Pipeline•Build Weblogs Pipeline•Build IP Location Pipeline•Build Currency Pipeline•Build Streaming PipelineModule 4:•Build Curated Product Pipeline•Build Curated Customer Pipeline•Build Curated Order Pipeline•Build Curated Weblogs Pipeline•Build Curated Streaming PipelineModule 5:•Databricks SQL Concept•Build Foundation of Gold Layer•Build Gold Layer•Create Query•Develop DashboardModule 5:•Databricks SQL Concept•Build Foundation of Gold Layer•Build Gold Layer•Create Query•Develop DashboardModule 6:•Develop Bronze Layer Workflow•Develop Silver Layer Workflow•Develop Gold Layer Workflow

Overview

Section 1: Introduction

Lecture 1 Course Introduction

Section 2: Databricks Basics

Lecture 2 Agenda

Lecture 3 Setup Azure Account

Lecture 4 Setup Workspace

Lecture 5 Navigate the Workspace

Lecture 6 Clusters

Lecture 7 What is Notebook

Lecture 8 What is Libraries

Lecture 9 Databricks File System (DBFS)

Lecture 10 DBUTILS

Lecture 11 Widgets

Section 3: Delta Lake Understanding

Lecture 12 Agenda

Lecture 13 What Is Data LakeHouse

Lecture 14 Delta Lake

Lecture 15 Lab : Create Delta Table

Lecture 16 Lab : Read & Write Delta Table

Lecture 17 Lab : Update / Delete / Merge

Lecture 18 Lab : Schema Validation

Lecture 19 Lab : Time Travel

Lecture 20 Lab : Generated Columns

Section 4: DataLakehouse Architecture

Lecture 21 Architecture

Lecture 22 Mediallion Architecture

Section 5: Build Bronze Layer

Lecture 23 Agenda

Lecture 24 Lab : Configure data Source

Lecture 25 Lab : Developing Product Pipeline

Lecture 26 Lab : Build Customer Pipeline

Lecture 27 Lab : Build Order Pipeline

Lecture 28 Lab : Build Weblogs Pipeline

Lecture 29 Lab : Ip Location

Lecture 30 Lab : Build Currency Pipeline

Lecture 31 Lab: Build Real Time & Streaming Pipeline Part -1

Lecture 32 Lab : Build Real Time & Streaming Pipeline Part -2

Section 6: Build Silver Layer

Lecture 33 Agenda

Lecture 34 Lab : Build Silver Customer Pipeline

Lecture 35 Lab : Build Silver Product Pipeline

Lecture 36 Lab : Build Silver Order PIpeline

Lecture 37 Lab : Build Weblogs

Section 7: Build Gold Layer

Lecture 38 Agenda

Lecture 39 Databricks SQL Concept

Lecture 40 Lab : Build Foundation of Gold Layer

Lecture 41 Lab: Build Gold Layer

Lecture 42 Lab : Create Query

Lecture 43 Lab : Develop Dashboard

Section 8: Orchestration

Lecture 44 Lab : Develop bronze layer workflow

Lecture 45 Lab : Develop silver layer workflow

Lecture 46 Lab : Develop gold layer workflow

Data Engineering Students & Developers,Bigdata Developer,Python & SQL Developer