PySpark - Python Spark Hadoop coding framework & testing
PySpark - Python Spark Hadoop coding framework & testing
Duration: 2h 3m | .MP4 1280x720, 30 fps(r) | AAC, 44100 Hz, 2ch | 897 MB
Genre: eLearning | Language: English
Duration: 2h 3m | .MP4 1280x720, 30 fps(r) | AAC, 44100 Hz, 2ch | 897 MB
Genre: eLearning | Language: English
Big data Python Spark PySpark coding framework logging error handling unit testing PyCharm PostgreSQL Hive data pipeline
What you'll learn
Python Spark PySpark industry standard coding practices - Logging, Error Handling, reading configuration, unit testing
Building a data pipeline using Hive, Spark and PostgreSQL
Python Spark Hadoop development using PyCharm
Requirements
Basic programming skills
Basic database skills
Hadoop entry level knowledge
Description
This course will bridge the gap between your academic and real world knowledge and prepare you for an entry level Big Data Python Spark developer role. You will learn the following
Python Spark coding best practices
Logging
Error Handling
Reading configuration from properties file
Doing development work using PyCharm
Using your local environment as a Hadoop Hive environment
Reading and writing to a Postgres database using Spark
Python unit testing framework
Building a data pipeline using Hadoop , Spark and Postgres
Prerequisites :
Basic programming skills
Basic database knowledge
Hadoop entry level knowledge
Who this course is for:
Students looking at moving from Big Data Spark academic background to a real world developer role
More Info
PySpark - Python Spark Hadoop coding framework & testing
