Tags
Language
Tags
May 2024
Su Mo Tu We Th Fr Sa
28 29 30 1 2 3 4
5 6 7 8 9 10 11
12 13 14 15 16 17 18
19 20 21 22 23 24 25
26 27 28 29 30 31 1

Distributed Tasks Demystified With Celery, Sqs & Python

Posted By: ELK1nG
Distributed Tasks Demystified With Celery, Sqs & Python

Distributed Tasks Demystified With Celery, Sqs & Python
Last updated 5/2019
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz
Language: English | Size: 1.37 GB | Duration: 4h 27m

Conjure up your first Python scalable background worker

What you'll learn
Fundamentals of multithreading in python
How to implement distributed tasks with Python & Django
Implement message passing communication between processes to build parallel applications
How to scale on the cloud with AWS Simple Queue Service (SQS)
Learn how to build a distributed social media data ingestor
Requirements
Have access to the internet
Elementary understanding of any programming language
Sublime Anaconda Python IDE or or any python IDE installed
Your enthusiasm to learn how to scale distributed applications
Description
This course teaches beginners to industry professionals the fundamental concepts of Distributed Programming in the context of python & Django.  We look at how to build applications that increase throughput and reduce latency.  In this course, we will take a dive intially in the irst part of the course and build a strong foundation of asynchronous parallel tasks using python-celery a distributed task queue framework. We will explore AWS SQS for scaling our parallel tasks on the cloud. These fundamentals will aid you in building scalable Python solutions for virtually any python project. By the end of this course, you will have learnt how to use popular distributed programming frameworks for python and Django. Through concepts learnt, you will discover the world of distributed computing with Python and how easy it is to build distributed components into your python or Django projects.

Why take this course?

As to be python developer or Django web application developer, Its important to learn how to build applications that are able to process long running jobs or tasks in a non blocking way e.g sending mass email, map reduce, running high computational functions. Building a chatting applications.This course builds up your skills in distribute programming giving you the tools you need to scale your applications

This course consist of projects you can use to implement in your real world projects with the sole emphasis of allowing your applications to become distributed and have asynchronous components  

During the course, you will have online access to the instructor and get individualized answers to your questions posted on forums.As an enrolled student you will get lifetime access to over 30 lectures plus and counting including future series of lessonsThis course comes with a 30 day money back guarantee! This means If you are not satisfied in any way, you'll get your money back. Though you may just miss out of the future existing lessons planned ahead and free source code for your own personal or business projects. So what are you waiting for? 

"Come join me and lets build distributed Python apps in a way that will advance your career, enhance your knowledge and potiential to earn even more. The best part is this doesnt need to be hard it actually can be fun"

Overview

Section 1: Introduction

Lecture 1 Introduction

Lecture 2 Prepping up your environment

Section 2: Getting started with Multithreading in Python

Lecture 3 Blocking vs non blocking (part 1)

Lecture 4 Blocking vs non blocking (part 2)

Lecture 5 Concurrency Consumer & Producer problem a deep dive

Lecture 6 Solving Consumer producers problem with Mutual Exlusion

Lecture 7 Controlling threads with conditions (Part 1)

Lecture 8 Controlling threads with conditions (Part 2)

Lecture 9 Controlling threads with conditions (Part 3)

Lecture 10 Daemon threads by example (Part 4)

Lecture 11 Consumer producer a thread safe FIFO queue

Section 3: Core Celery Distributed Tasks

Lecture 12 Getting started with Celery

Lecture 13 Celery backends & Asyncresult by example

Lecture 14 Python exception handling back to the basics

Lecture 15 Exception handling in Celery Explained

Lecture 16 Celery scheduled periodic tasks (Part 1)

Lecture 17 Celery scheduled periodic tasks (Part 2)

Lecture 18 Celery scheduled periodic tasks How to apply Mutex (Part 3)

Lecture 19 Celery scheduled periodic tasks solar schedules

Section 4: Distributed tasks with AWS SQS

Lecture 20 Introduction to distributed tasks with AWS SQS

Lecture 21 Creating your first AWS SQS Queue with your AWS Console

Lecture 22 How to create a AWS SQS background worker in python (Part 1)

Lecture 23 How to create a AWS SQS background worker in python (Part 2)

Lecture 24 Dead-letter Queues the theory

Lecture 25 Dead-letter Queues illustrated

Lecture 26 How to bypass AWS SQS (Simple Queue Service) 256kb payload limit

Section 5: Distributed data ingestor Project #1

Lecture 27 Introduction Project #1

Lecture 28 Real world examples of data ingestors

Lecture 29 Creating a twitter developer application and Authentication Token

Lecture 30 Building your first social ingestor twitter (Part 1)

Lecture 31 Building your first social ingestor twitter (Part 2)

Lecture 32 Building your first social ingestor twitter Rate Limits (Part 3)

Lecture 33 Building your first social ingestor twitter Handle (Part 4)

Lecture 34 Building your first social ingestor twitter Handle (Part 5)

Section 6: Distributed Email Workers Project #2

Lecture 35 Basic fundamentals of SMTP and transactional email Services

Lecture 36 Creating your first background email worker (Part 1)

Lecture 37 Creating your first background email worker (Part 2)

Lecture 38 Creating your first background email worker (Part 3)

Section 7: Python Development Tools

Lecture 39 Quick start guide: Getting started with PyCharm IDE (Mac)

Complete beginners to python programming language,Non Python programmers looking to explore distributed programming in python,Aspiring Technical Founders looking to implement distributed applications,Anyone wishing to learn how distributed programming works in python,Anyone wishing to implement asynchronous programming in python web applications