Intro To Data Engineering

Get an Introduction to the Data Engineering and Explore the Career Opportunities It Offers

What you'll learn

Determine if data engineering is the right career choice for you

Learn data engineering fundamentals

Acquire key technical data engineering skills

Discover potential career paths within data engineering

Benefit from the knowledge of an experienced data engineer

Learn strategies to enhance data processes at your company

Requirements

This is a beginner-friendly course

Description

Do you want to find out if Data Engineering is the right career path for you?Are you interested in exploring one of the hottest tech professions?If that’s the case, then our Intro to Data Engineering course is the perfect fit for you. Learn data engineering from course instructor Shashank Kalanithi, who has rich experience in the data and tech field. He has held roles as a data analyst, data scientist, data engineer, and currently works as a software engineer at Meta. Shashank is passionate about teaching and is eager to pass on his experience to you. His engaging teaching style combined with his notable professional experience make him the perfect tutor for you.But what does a data engineer do? A data engineer designs, builds, and maintains systems for collecting, storing, and analyzing data.Our data engineering course is perfect for people who are looking into a career in data engineering, as well as for those who have already landed a data engineering job but are still in the early days of their journey.Why is this the perfect course for data newcomers? You will:- Be able to determine if data engineering is a career path that interests you- Understand the difference between common roles: data analyst vs data scientist vs data engineer vs software engineer (note: data engineering skills allow you to transition to any of the other roles as you advance in your career)- Learn fundamental data engineering concepts, how to become a data engineer, and how to land your first jobWhy is this the perfect course for entry level data engineers? You will:Gain a big picture understanding of the data engineering field and its requirementsBenefit from Shashank's years of experience and gain valuable insights to excel in your jobUnderstand the different paths you can take in your career progressionDiscover methods to enhance data engineering processes within your companyWhat’s included in our data engineer training?Intro to Data Engineering begins with an overview of the data engineering career path. You will learn about the data engineering role, the technical skills needed on the job, and the different potential paths for career development.Then, you will learn about data architecture—a critical topic in data engineering. This field involves creating a structured framework for managing data. You'll also explore data orchestration, which is the automation of the flow and processing of data across different systems.Our data engineering course also covers relational databases, non-relational databases, and the software engineering skills required for data engineering. You will learn about crucial data engineering tools and frameworks like SQL, NoSQL, Python, APIs, Version Control, Docker and Containerization, Hadoop, Spark, Kafka, and more. Finally, Shashank will wrap up the Intro to Data Engineering course with insights on important aspects like data security and privacy.We hope you are very excited about this course! Start your data engineering journey today!

Overview

Section 1: Introduction

Lecture 1 What Will This Course Teach You

Section 2: Data Engineering Career

Lecture 2 What is a Data Engineer?

Lecture 3 Data Engineering Lifecycle

Lecture 4 Similar Careers to Data Engineering

Lecture 5 Data Engineering Service Models

Lecture 6 Data Engineer Leveling Guide

Lecture 7 Technical Skills of a Data Engineer

Section 3: Data Architecture

Lecture 8 What Is Data Architecture?

Lecture 9 A Sample Data Architecture

Lecture 10 Data Lakes, Swamps, Warehouses, and Marts

Lecture 11 Modern Data Stack

Lecture 12 Connecting to Data

Lecture 13 Good Data Architecture

Section 4: Data Orchestration

Lecture 14 Data Pipelines and Data Orchestration

Lecture 15 Apache Airflow

Section 5: Relational Databases

Lecture 16 Relational Database Overview

Lecture 17 Organizing Relational Databases

Lecture 18 Relational Database Types

Lecture 19 Interacting with Relational Databases: SQL

Section 6: Non-relational Databases

Lecture 20 ACID Properties

Lecture 21 Document Databases

Lecture 22 Key-Value Database

Lecture 23 Object Storage

Lecture 24 Columnar Database

Lecture 25 Graph Database

Lecture 26 No-SQL Database Questions

Section 7: Software Engineering

Lecture 27 Horizontal Scaling vs Vertical Scaling

Lecture 28 Python

Lecture 29 APIs

Lecture 30 Shell Scripting

Lecture 31 Cron

Lecture 32 Version Control - Git - Mercurial

Lecture 33 Testing

Lecture 34 Docker and Containerization

Lecture 35 Infrastructure Management

Section 8: Big Data Engineering

Lecture 36 What is Big Data?

Lecture 37 Hadoop

Lecture 38 Spark

Lecture 39 Kafka

Section 9: Data Modeling

Lecture 40 Logical Physical Data Model

Lecture 41 Entity Relationship Diagrams

Lecture 42 Normalization

Lecture 43 Kimball and Inmon Data Warehousing

Section 10: Security and Privacy

Lecture 44 The Non-optionality of Security and Privacy

Lecture 45 PII

Lecture 46 Principle of Least Privilege

Aspiring data engineers,Introductory data engineers looking to improve their skills