Tags
Language
Tags
March 2024
Su Mo Tu We Th Fr Sa
25 26 27 28 29 1 2
3 4 5 6 7 8 9
10 11 12 13 14 15 16
17 18 19 20 21 22 23
24 25 26 27 28 29 30
31 1 2 3 4 5 6

Spark Scala coding framework & best practices in real world

Posted By: Sigha
Spark Scala coding framework & best practices in real world

Spark Scala coding framework & best practices in real world
Video: .mp4 (1280x720, 30 fps(r)) | Audio: aac, 44100 Hz, 2ch | Size: 846 MB
Genre: eLearning Video | Duration: 21 lectures (1 hour, 41 mins) | Language: English

Spark Scala Framework, Hive, IntelliJ, Maven, Winutil, Postgres, Logging, Exception Handling, log4j, Cloudera QuickStart.

What you'll learn

Spark Scala industry standard coding practices - Logging, Exception Handling, Reading from Configuration File
Building a data pipeline using Hive, Spark and PostgreSQL
Spark Scala development with Intellij, Maven
Cloudera QuickStart VM setup on GCP


Requirements

Basic Big Data, Spark knowledge required

Description

This course will bridge the gap between your academic and real world knowledge and prepare you for an entry level Big Data Spark Scala developer role. You will learn the following

Spark Scala coding best practices

Logging - log4j, slf4

Exception Handling

Configuration using Typesafe config

Doing development work using IntelliJ, Maven

Using your local environment as a Hadoop Hive environment

Reading and writing to a Postgres database using Spark

Building a data pipeline using Hadoop , Spark and Postgres

Bonus - Setting up Cloudera QuickStart VM on Google Cloud Platform (GCP)


Prerequisites :

Basic programming skills

Basic database knowledge

Big Data and Spark entry level knowledge



Who this course is for:

Students looking at moving from Big Data Spark academic background to a real world developer role

Spark Scala coding framework & best practices in real world


For More Courses Visit & Bookmark Your Preferred Language Blog
From Here: English - Français - Italiano - Deutsch - Español - Português - Polski - Türkçe - Русский


Download Links