Snowflake Mastery: Easy Steps To Gain Expertise [2023]

Snowflake Mastery: An easy step by step approach to be an expert in snowflake

What you'll learn

You will learn about the Snowflake Architecture and Performance management

Deep Dive in to the Access management and the type of Db objects

Understand in full detail how the data moves from external system to Snowflake

Deep knowledge on Dynamic data masking and visualization

Extensive knowledge on Data Sharing and Data Protection

Requirements

No Programming experience needed. You will learn every thing from scratch. However a basic understanding of relational database and SQl is required.

Description

Are you a technology professional or college graduate who have thought multiple times to learn snowflake but couldn't learn it so far? Is your self snowflake learning a struggle? As a busy technology professional, do you feel overwhelmed and frustrated with all the 'answers' to master snowflake, but still not sure which one is right for you? Have you wondered, how many days , weeks and months are passed in just thinking about learning snowflake? The time is NOW to get started.In this course, you will discover exactly what you need to focus on to master snowflake. We will take you through an easy step by step approach to learn and master snowflake in shortest period of time with out overwhelm.Cloud is the new norm, almost all tech giants are moving towards cloud platform for the solutions which are cost effective and scalable. Cloud data-warehousing aka Snowflake warehouse is one the fastest growing technology which most of the technology companies are adopting. This is going to be big in future, hence this is the right time to get into the ship to learn and equip ourselves will all the knowledge of snowflake and prepare ourselves for better career today and in future. So if you find yourself saying "May be I will try it another time ". I would say THE TIME IS NOW. Don't let yourself go another day, another week, another month of learning procrastination. It's time RIGHT NOW to get on the journey of learning and have the life knowledge and excellent career you have designed for you.Following modules will be covered in a very easily step by step approachSnowflake Architecture and Performance ManagementIntroductionCreate Trial accountKnow your UI interfaceShared and Non Shared Disk ArchitectureHigh Level ArchitectureCreate Virtual WarehousesScaling PolicyCreate First Database and TableLoad CSV from public S3 bucketSnowflake ArchitectureSnowflake EditionsCreditsCredit Usage ScenariosCredit to Dollar Storage costCredit Storage ConsumptionPerformance ManagementPerformance Improvement MethodsDedicated Virtual WarehousesDedicated Virtual Warehouses CreationScale Up and Scale DownScale Out and Scale InMaximize CachingMaximize Caching demonstrationClustering KeysClustering CostClustering PerformanceMicropartitionsAccess management and snowflake objectsAccess managementAccess control and RBACSecurable objectsRolesTables in snowflakeTable TypesDatabase and schema typeUser Defined Functions (UDF’s) and Stored ProceduresUser defined functions (UDF’s)Stored procedures (SP’s)Secure UDF’s and SP’sViewsNon Materialized viewsMaterialized viewsData Movement - Techniques and UnloadingData Loading techniquesTypes of Data loadKnow snowflake stagesInstall SnowsqlInternal StagesUserstageTablestageNamedstageExternal StagesCOPY CommandCOPY TransformationFile Format ObjectCOPY OPTIONSON ERRORSIZE LIMITRETURN_FAILED_ONLYENFORCE_LENGTH / TRUNCATECOLUMNSFORCE / LOAD_UNCERTAIN_FILESLOAD_HISTORYVALIDATION MODELogging rejected recordsData loading best practicesData UnloadingData unloading theoryCOPY into location - Internal Stage -> User stageResolving max_workers must be greater than 0COPY into location - Internal Stage -> Table stageCOPY into location - Internal Stage -> Named Internal StageUnloading using QueryUnloading to Multiple FilesData Movement - Data loadingLoading from AWSCreate AWS free-tier accountCreate S3 bucket, file and roleStorage integration objectLoad file from AWSUnload data to AWSLoading from AzureCreate Azure free trial accountCreate storage and containerIntegration objectLoad data from AzureUnload data to AzureLoading from GCPCreate GCP free trial account, create bucket and upload fileIntegration objectLoad data from GCPUnload data to GCPLoading Semi-Structured DataIntroductionProcess and understanding the demo dataJSON: Load raw data and analyze nested objectsJSON: FLATTENArray/ObjectsHierarchicalJSON: Data transformation and loadJSON: Querying DataPARQUET: File load and transformationSnowpipeOverviewCreate snowpipe, load and configureTroubleshooting and pipe refreshManage snowpipeDynamic Data Masking and VisualizationDynamic data maskingOverviewCreate masking policyChange, Unset and replace masking policyConditional maskingData VisualizationSnowsight - Dashboard and VisualizationGetting started with TableauTableau visualization from snowflake dataPartner ConnectOverviewPartner connect categoriesData Sharing and Data ProtectionData SharingOverviewData sharing demo of Table, External tables and UDF’s.Data share to a reader accountImported privilegesData share - entire databaseData share operations - DDL and DML affectSharing views and materialized viewsTime TravelOverview and retrieve data using “at” and “before”Data restoration using direct methodData restoration using indirect methodUNDROPUnderstanding retention timeFail-SafeOverviewFail Safe demoZero-Copy CloningOverviewCloning permanent tablesCopy grants and clone temporary external tablesClone schema and databaseSwapClone using time travel and understand sharing vs cloningStreamsOverviewConsuming streams using insert, update and deleteTypes of streams - default, append only. Consume stream using false conditionInsert only streams for external tablesMultiple consumers with streamsChanges clauseStreams consideration and stale after attributeRecreate, rename and clone effect on streamTasksUnderstanding tasksCreate task using procedure when and troubleshoot taskScheduling tasks using CRONCRON - Daylight savings considerationsDAG - Tree of tasksTask with streamUser managed tasks and warehouse considerationsSampling DataOverviewRow sampling methodSystem block methodAccess management in practiceSystem defined roles and its usersCustom roles and its usersCreate objects from sysadmin role and assign to developer roleCreate custom users - developer1, developer2,qa1 and reader1Problems due to unassigned custom rolesSolution of the problemsPublic RoleBest PracticesAuto resume, success and failure and long running queriesResource monitorColumns storage cost and benchmarking the queriesEnjoy and Happy Learning !

Overview

Section 1: Getting Started

Lecture 1 Welcome and Course Structure

Lecture 2 Alphaedge Solutions disclaimer and instructors

Lecture 3 Course Resources

Lecture 4 Few Actions before you launch your learning

Section 2: Introduction

Lecture 5 Create trial account

Lecture 6 Know your UI interface

Lecture 7 Share and non share disc architecture

Lecture 8 High level snowflake architecture

Lecture 9 Virtual warehouse sizes

Lecture 10 Create virtual warehouse

Lecture 11 Scaling policy

Lecture 12 Create first database and table

Lecture 13 Load csv file from public S3 bucket

Section 3: Snowflake Architecture

Lecture 14 Snowflake editions

Lecture 15 Credits

Lecture 16 Minumum 1 minute concept

Lecture 17 Credit usage scenarios

Lecture 18 Credit to dollar storage cost

Lecture 19 Credit consumption for storage

Section 4: Performance management

Lecture 20 Performance improvement methods

Lecture 21 Dedicated virtual warehouses

Lecture 22 Dedicated Virtual warehouse creation

Lecture 23 Scale up and Scale down

Lecture 24 Scale out and Scale in

Lecture 25 Maximize caching

Lecture 26 Maximize caching demonstration

Lecture 27 Clustering keys

Lecture 28 Clustering costs

Lecture 29 Clustering performance

Lecture 30 Micropartitions

Lecture 31 Micropartitions - query pruning, depths and overlap

Section 5: Access management

Lecture 32 Access control and RBAC

Lecture 33 Securable objects

Lecture 34 Roles

Section 6: Tables in snowflake

Lecture 35 Table types

Lecture 36 Database and schema types

Section 7: User defined functions (UDF's) and Stored procedures

Lecture 37 User defined functions (UDF's)

Lecture 38 Stored procedures (SP's)

Lecture 39 Secure UDF's and SP's

Section 8: Views

Lecture 40 Non materialized views

Lecture 41 Materialized views

Lecture 42 Refresh materialized view

Section 9: Data loading

Lecture 43 Data loading techniques

Lecture 44 Know snowflake stages

Lecture 45 Install SNOWSQL

Lecture 46 Internal stages - Userstage

Lecture 47 Internal stages - Tablestage

Lecture 48 Internal stages - Namedstage

Lecture 49 External stages

Lecture 50 COPY command

Lecture 51 COPY Transformations1

Lecture 52 COPY Transformations2

Lecture 53 File format object

Lecture 54 File format object properties

Section 10: COPY OPTIONS

Lecture 55 ON_ERROR - CONTINUE

Lecture 56 ON_ERROR - SKIP_FILE

Lecture 57 SIZE_LIMIT

Lecture 58 RETURN_FAILED_ONLY

Lecture 59 ENFORCE_LENGTH/TRUNCATECOLUMNS

Lecture 60 FORCE/LOAD_UNCERTAIN_FILES

Lecture 61 LOAD_HISTORY

Lecture 62 VALIDATION MODE - RETURN_ERRORS

Lecture 63 VALIDATION MODE - RETURN__ROWS/RETURN_ALL_ERRORS

Lecture 64 Logging rejected records using RESULT_SCAN

Lecture 65 Logging rejected records using validate

Lecture 66 Data loading best practices1

Lecture 67 Data loading best practices2

Section 11: Data Unloading

Lecture 68 Data unloading theory

Lecture 69 COPY into location: Internalstage -> Userstage

Lecture 70 COPY into location: Internalstage -> Tablestage

Lecture 71 COPY into location: Internalstage -> Named internalstage

Lecture 72 Unloading using query

Lecture 73 Unloading multiple files

Section 12: Loading and Unloading from AWS

Lecture 74 Create AWS free-tier account

Lecture 75 Create S3 bucket, file and role

Lecture 76 Storage integration object

Lecture 77 Load file from AWS

Lecture 78 Unload data to AWS

Section 13: Loading and Unloading from AZURE

Lecture 79 Create azure free trial account

Lecture 80 Create storage and container

Lecture 81 Integration object

Lecture 82 Load data from Azure

Lecture 83 Unload data to Azure

Section 14: Loading and Unloading from GCP

Lecture 84 Create GCP trial account, create bucket and upload file

Lecture 85 Integration object

Lecture 86 Load data from GCP

Lecture 87 Unload data to GCP

Section 15: Loading Semi-Structured data

Lecture 88 Introduction

Lecture 89 Process and understanding the demo data

Lecture 90 JSON: Load raw data and analyse nested objects

Lecture 91 JSON: FLATTEN

Lecture 92 JSON: Data load and transformation

Lecture 93 PARQUET: File load and transformation

Section 16: Snowpipe

Lecture 94 Overview

Lecture 95 Create snowpipe, load and configure

Lecture 96 Troubleshooting and pipe refresh

Lecture 97 Manage snowpipe

Section 17: Dynamic Data Masking

Lecture 98 Dynamic data masking overview

Lecture 99 Create dynamic data masking policy

Lecture 100 Masking policy and policy reference

Lecture 101 Masking policy on multiple columns, nested masking and real life examples

Lecture 102 Masking policy context and conditional masking

Section 18: Data Visualization

Lecture 103 Data setup for visualization

Lecture 104 Snowsight charts and visualization

Lecture 105 Tableau installation

Lecture 106 Snowflake ODBC driver

Lecture 107 Tableau visualization from snowflake data

Section 19: Partner Connect

Lecture 108 Overview

Lecture 109 Partner connect demo

Section 20: Data Sharing

Lecture 110 Data sharing overview

Lecture 111 Create Table, external table and UDF's for data sharing

Lecture 112 Data sharing demo of table, external table and UDF

Lecture 113 Create data share via UI

Lecture 114 Data share to a reader account

Lecture 115 Imported privileges

Lecture 116 Data share - entire database

Lecture 117 Data share operations - DDL and DML affect

Lecture 118 Sharing views and materialized views

Section 21: Time Travel

Lecture 119 Time travel overview

Lecture 120 Retrieve data using "at" and "before"

Lecture 121 Data restoration using direct method

Lecture 122 Data restoration using indirect method

Lecture 123 UNDROP

Lecture 124 Understanding retention time

Section 22: FAILSAFE

Lecture 125 Overview

Lecture 126 Failsafe demo

Section 23: Zero Copy Cloning

Lecture 127 Overview

Lecture 128 Cloning permanent tables

Lecture 129 Copy grants and more on cloning

Lecture 130 Clone schema and database

Lecture 131 Swap

Lecture 132 Clone using time travel and understand sharing vs cloning

Section 24: Streams

Lecture 133 Streams Overview

Lecture 134 Streams Offset

Lecture 135 Consuming streams using insert, update and delete

Lecture 136 Types of streams - default, append only. Consume stream using false condition

Lecture 137 Insert only streams for external tables

Lecture 138 Multiple consumers with streams

Lecture 139 Changes clause

Lecture 140 Streams stale_after and extension in days

Lecture 141 Recreate, rename and clone effect on stream

Section 25: Tasks

Lecture 142 Understanding tasks

Lecture 143 Create tasks using procedure when and troubleshoot tasks

Lecture 144 Schedule task using CRON

Lecture 145 CRON - Day light savings considerations

Lecture 146 DAG - Tree of tasks

Lecture 147 Task with stream

Lecture 148 User managed tasks and warehouse considerations

Section 26: Sampling Data

Lecture 149 Overview

Lecture 150 Row sampling method

Lecture 151 System block method

Section 27: Access management in practice

Lecture 152 System defined roles and its users

Lecture 153 Custom roles and its users

Lecture 154 Create objects from sysadmin role and assign to developer role

Lecture 155 Create custom users - developer1, developer2, qa1 and reader1

Lecture 156 Problems due to unassigned custom roles

Lecture 157 Solution of the problems

Lecture 158 Public Role

Section 28: Best Practices

Lecture 159 Auto resume, success and failure and long running queries

Lecture 160 Resource monitor

Lecture 161 Resource monitor via SQL

Lecture 162 Resource monitor with custom schedule

Lecture 163 Columns storage cost and benchmarking the queries

Section 29: Thank you

Lecture 164 Thank you note, stay connected and good luck !

Have you wondered, how many days , weeks and months are passed in just thinking about learning snowflake? In this free challenge you will kickstart your journey towards snowflake. The time is NOW to get started.