ETL using Python: from MySQL to BigQuery

A course for supercharged analysts

What you'll learn
Connect to MySQL using Python
Connect to BigQuery using Python
ETL data from MySQL to BigQuery using Python
Setting up their environment to use Python with MySQL and BigQuery

Requirements
Python installed (e.g. virtual environment, anaconda, etc…)
Familiarity with SQL
Familiarity with Python
GCP Account for BigQuery Access
An IDE like VS Code or PyCharm

Description
This is a direct and to the point course that will get you quickly ETL'ing data from MySQL to BigQuery. The lessons in this course are broken out into short How-Tos. Therefore you can take this course over the weekend and be ready to show off your skills on Monday morning!Things that we will cover:SetupSetting up a GCP AccountCredential and Authentication for securityPython Environment SetupExtractUse Python to connect to MySQLUse Python's pandas to export dataPython library usage for saving files to file pathsTransformUse Python functions to transform dataUse Python pandas to transform dataUse inline SQL during Extract for data transformationLoadUse the BigQuery Python libraryConnect to BigQueryLoad data to BigQueryIncremental Loads vs Truncate and LoadOther data handling options during LoadAfter taking this course, you'll be comfortable with the following pretty cool things:Connect to MySQL using PythonLearn how to obscure your database credentials so you're not exposing them in your codeUsage of the os module for the purpose of saving files and hard coding fewer things.Use both Python and the pandas library to transform data on the fly during the Transformation phase of your ETLLearn how to use GBQ's modules/libraries to make the loading of the data a very easy, straightforward taskHave fun, enjoy and keep growing!

Who this course is for:
Business Intelligence Analysts, Data Analysts, Beginner Data Engineers, Beginner Software Developers, Data Power Users