Databricks Certified Data Engineer Associate + Practice Test

Full practice exam included + explanations | Learn Databricks | Become a Databricks Data Engineer Associate

What you'll learn

Pass the Databricks Data Engineer Associate certification

Understand the basics of Databricks

Use Databricks in your day-to-day job

Be confident in interviews requiring Databaricks knowledge

Requirements

No python nor spark knowledge required at all

Very basic SQL experience can be useful, but do not worry, we will go over the basics when required

Description

If you are interested in learning Databricks while having no background at all, and successfully pass the official Data Engineer Associate certification, you are at the right place!At the end of this course, you will:Understand how Databricks was designed Control Plane, Compute Plane and their integration with your cloud providerThe benefits of a Data Lakehouse over Data Warehouse and Data LakesThe Medallion architectureHow to navigate the tools & features provided by DatabricksClustersNotebooksSQL Engine (SQL Warehouse Serverless, …)SparkTable constraintsManipulate data easilyRead from tables & filesApply various Spark SQL methodsUse stored views, temporary views, global temporary viewsNavigate externable tables & managed tables and their differencesData Storage of the tables (parquet, transactional logs, …)Understand the benefits of Delta LakeACID TransactionsData storage optimizationNavigate the history of your tables, and revert to previous versionsUse Delta Live Tables to run your Data Engineering pipelinesStreaming tables for low latencyThe different pipeline modes to schedule jobs or run continuous jobsPlan your tasks Investigate logsUnderstand Change Data Stream in an event based architectureUnderstand how Data Governance is applied on DatabricksUnity Catalog vs Hive MetastoreThe various entities availableThe access rights for each of these entitiesWith all the knowledge, and experience through a lot of Hands On, acquired through this course, you will be ready to pass the official Databricks Data Engineer Associate certification!

Overview

Section 1: Introduction

Lecture 1 Introduction

Lecture 2 Structure of the course

Lecture 3 Databricks - What is it?

Lecture 4 Create a Community Databricks Account

Lecture 5 Create an AWS Databricks Account

Lecture 6 Create an Azure Databricks Account

Lecture 7 Resources

Section 2: Databricks Lakehouse Platform

Lecture 8 Data Lakehouse

Lecture 9 Medallion Architecture

Lecture 10 Compute and Control Planes

Lecture 11 Clusters

Lecture 12 Clusters - Community Edition - Hands On

Lecture 13 Clusters - Cloud Provider-linked Edition - Hands On

Lecture 14 Notebooks

Lecture 15 Git

Lecture 16 Git - Hands On

Lecture 17 CI - CD

Lecture 18 SQL

Section 3: Data Transformation with Apache Spark

Lecture 19 Data Storage

Lecture 20 Data Storage - Hands On

Lecture 21 Follow along the examples

Lecture 22 Follow along the examples - Hands On

Lecture 23 Read & Write

Lecture 24 Read & Write - Hands On

Lecture 25 Views

Lecture 26 Views - Hands On

Lecture 27 Spark SQL Methods

Lecture 28 Spark SQL Methods - Hands On

Lecture 29 Json

Lecture 30 Json - Hands On

Lecture 31 Advanced SQL Features

Lecture 32 Advanced SQL Features - Hands On

Lecture 33 Constraints & Deduplication

Lecture 34 Deduplication - Hands On

Section 4: Data Management with Delta Lake

Lecture 35 Delta Lake

Lecture 36 Delta Lake - Hands On

Lecture 37 Acid Transactions

Lecture 38 Tables

Lecture 39 Tables - Hands On

Lecture 40 Parallelism

Lecture 41 Parallelism - Hands On

Lecture 42 CTAS

Lecture 43 Generated Column

Lecture 44 Merge Into

Lecture 45 Copy Into

Section 5: Data Pipelines with Delta Live Tables

Lecture 46 Delta Live Tables

Lecture 47 Delta Live Tables - Hands On

Lecture 48 Auto Loader

Lecture 49 Change Data Capture

Lecture 50 Monitoring

Section 6: Workloads with Workflows

Lecture 51 Jobs

Lecture 52 Jobs - Hands On

Section 7: Data Access with Unity Catalog

Lecture 53 Data Governance

Lecture 54 Manage Access

Lecture 55 Cluster Security Mode

Lecture 56 Identity Management

Lecture 57 SQL Warehouse

Section 8: Final Notes & Practice Test

Lecture 58 Final notes

People eager to pass their Databricks Data Engineer Associate certification,People eager to understand what is Databricks