Securing And Sharing Data Lake Data Using Aws Lake Formation

Empower your data journey with AWS Lake Formation. Get up to speed with sharing DataLake data using Lake Formation.

What you'll learn

This course is a deep into the AWS Lake Formation service that enables Data teams build, secure and share data lake data quickly and easily.

By the end of this course, you will be clear and comfortable on using Lake Formation features on real enterprise level Data Lakes on AWS.

Getting familiar with Lake Formation Hybrid Access mode feature and its key benefits.

Practical Hands-on exercises that will help you learn how to use Lake Formation for securely sharing the DataLake data.

Requirements

Familiarity with Data Lakes on AWS

Familiarity with these AWS services - Amazon S3, Amazon Athena, AWS Glue and AWS Identity and Access Management (IAM)

Description

Hello and welcome to this course on - "Securing and Sharing Data Lake data using AWS Lake Formation". This course is primarily a deep dive into the AWS Lake Formation Service, which is one of the essential pillars for data lakes on AWS. Prior to the launch of Lake Formation and its database-style fine grained permissions for data lakes, one had to manage access to the data in the data lake and its metadata separately through AWS Identity and Access Management (IAM) policies and S3 bucket policies. This was relatively much more complex and also less granular compared to Lake Formation.AWS Lake Formation is a fully managed service that simplifies the cumbersome process of securing and managing data lakes, hence streamlining Data Management and enabling improved Data Discovery along with enhanced Security. In this course you will get to learn and experiment (via Practical hands-on exercises) the key components of Lake Formation and how to use it to securely share the DataLake data to different personas (having varied use-cases on the DataLake). In this course you will also get to learn about the Lake Formation Hybrid Access mode feature which was launched in the recent past (September, 2023), and that it enables data administrators to onboard Lake Formation permissions selectively and incrementally.So Lets gets started to empower your data journey with AWS Lake Formation !!

Overview

Section 1: Introduction

Lecture 1 Introduction to the course

Lecture 2 Pre-requisites

Lecture 3 Optional: Setting up budget in AWS prior using required services

Section 2: What is AWS Lake Formation and its significance

Lecture 4 Challenges prior to Lake Formation

Lecture 5 Glance at the Official Definition

Lecture 6 A New Authorization Layer

Lecture 7 IAM & Lake Formation Permissions

Lecture 8 DB style Fine Grained Permissions

Lecture 9 Understanding Key LF Terminologies

Section 3: Lake Formation Hybrid Access Mode

Lecture 10 Limitations of using only Lake Formation Permissions Mode

Lecture 11 Introduction to Lake Formation Hybrid Access Mode, How it works

Lecture 12 Another key usecase of LF Hybrid Access Mode Feature

Lecture 13 Prerequisites, Considerations & Limitations for using Hybrid Access Mode

Section 4: Practical Hands-on Exercises on using AWS Lake Formation

Lecture 14 Optional: Overview of the AWS Lake Formation console

Lecture 15 Prerequisite: Overview of the DataLake Data

Lecture 16 Optional: step-by-step guide to setup the basic DataLake in Amazon S3

Lecture 17 Demo: Registering the DataLake with Lake Formation

Lecture 18 Optional: IAM permissions to be provided to Data Analyst

Lecture 19 Demo: Setting up Lake Formation Permissions for Data Analyst

Lecture 20 Lake Formation permissions management workflow

Lecture 21 Demo: Cross Account Data Sharing using Lake Formation

Lecture 22 Optional: Access Data Catalog resources from any AWS Region via Resource Links

Lecture 23 Setting up Cross-account Permissions for Data Engineer by AWS Glue methods

Lecture 24 Optional: Registering Glue Data Catalog from another account in Athena

Lecture 25 Demo: Challenges while using only Lake Formation Permission Mode

Lecture 26 Demo: using Lake Formation Hybrid Access Mode and its benefits

Lecture 27 Demo: Another key usecase of LF Hybrid Access Mode Feature

Section 5: Additional Topics

Lecture 28 Terraform code to enable Lake Formation for your S3 Data Lake

Data Engineers, Data Analysts, Operations teams managing Data Lakes on AWS,Any Data governance enthusiast who wishes to learn how to secure Data Lakes on AWS using Lake Formation