Scrapy : Python Web Scraping & Crawling for Beginners

Master web scraping with Scrapy and Python 3. Includes databases, web crawling, creating spiders and scraping Amazon.

What you'll learn

3.5+ hours of Full HD video material divided into 28 downloadable lectures
Scraping single or multiple websites with Scrapy
Building powerful crawlers and spiders
Creating a web crawler for amazon from scratch
Bypass restrictions using User-Agents and Proxies
Logging into Websites with Scrapy
Storing data extracted by Scrapy into SQLite3, MySQL and MongoDB databases
Exporting data extracted by Scrapy into CSV, XML, or JSON files
Understand Xpath and CSS selectors to extract data
Access to our PRIVATE Facebook group available to only students of this Scrapy course


Requirements

Python Level: Beginner. This Scrapy tutorial assumes that you already know the Python basics ( variables, functions etc. ) No need for more as we cover Object Oriented Programming in the BONUS section of this course.
Please watch the preview lectures and read the description of this course before enrolling.

Description

In early 2008, Scrapy was released into this world and it soon became the #1 Web Scraping tool for beginners. Why? It's because it's simple enough for beginners yet advanced enough for the pros. Here are some of the use cases -

Ecommerce ( Amazon ) - Scrape product names, pricing and reviews

Data - Get a huge collection of data/images for Machine Learning

Email Address - Big companies scrape it and use it for Lead Generation

Come learn with me and I'll show you how you can bend Scrapy to your will. This course is great for beginners in Python at any age and any level of computer literacy.

The goal is simple: learn Scrapy by working on real projects step-by-step while we explain every concept along the way. For the duration of this course we will take you on a journey and you're going to learn how to:

Scrape Data from nearly Any Website

Build your own Spiders from scratch for all types of Web Scraping purposes

Transfer the data that you have scraped into Json, CSV and XML

Store the data in databases - SQLite3, MySQL and MongoDB

Create Web Crawlers and follow links on any web page

Logging in into websites

Bypassing restrictions & bans by using User-Agents and Proxies

Internalize the concepts by completely scraping amazon and get ready to scrape more advance websites.

Who this course is for:

Anyone interested in learning how to Scrape Websites for Machine Learning
Python beginners and developers who are interested in learning Scrapy
Entrepreneurs and Growth Hackers
Freelancers who want to start/expand their careers by learning Web Scraping ( Lots of jobs on Upwork )
Students who wish to scrape complex websites and build interesting crawlers