Selenium 4 With Python For Web Automation And Data Scraping

The simplified, comprehensive, practical and hands-on, course on web automation and data scraping and real world project

What you'll learn

Automating the launch and execution of tasks on a browser, both visual and headless browsers

Understanding the browser architecture and how selenium controls a browser

Locating and scraping data from various elements on a webpage using selenium

Saving and exporting scraped data using python's pandas library

Best practices in python programming

Requirements

Knowhow on web programming (some knowledge in HTML, css and javascript)

Some knowledge on python programming

A computer, preferably running windows and is provisioned with internet access

Description

Get ready to revolutionize the way you work with our cutting-edge Web Automation and Data Scraping course! In this comprehensive and interactive course, you will discover the world of web automation and data scraping and learn how to automate mundane and repetitive tasks with ease. With hands-on experience in scripting and coding, you'll be able to extract valuable data from websites and transform it into actionable insights that could be useful for yourself or a client.Our course is designed to instill best practice in coding for automation and will take your skills to the next level, providing you some of the latest tools and techniques used by industry professionals. You'll learn how to write scripts in python and how to use the selenium framework. You'll also learn how to scrape data from dynamic websites, handle cookies and sessions, and how to deal with common web scraping challenges.Besides these, you'll also get the opportunity to work on real-world projects and apply your skills to real-world scenarios.Enroll in our Web Automation and Data Scraping course today and join a community of like-minded individuals who are passionate about data and technology. Whether you're looking to start a new career in data analysis or simply want to improve your existing skills, this course has everything you need to succeed. So don't wait any longer, unlock the power of web automation and data scraping and get ahead in today's data-driven world. Sign up now and take the first step towards a brighter future!

Overview

Section 1: Prerequisites

Lecture 1 Prerequisites

Section 2: GETTING STARTED & INSTALLATION OF NECESSARY UTILITIES

Lecture 2 Installing and Testing the Necessary Utilities

Lecture 3 Understanding a Browser Architecture

Lecture 4 What is a Webdriver

Lecture 5 Understanding the Working of Visual Studio Code

Lecture 6 Installing Selenium

Lecture 7 Installing WebdriverManager

Lecture 8 A Look at the Course Resource

Lecture 9 What is a Headless Browser

Lecture 10 What is Browser Options

Lecture 11 Running Javascript Code Via Selenium

Lecture 12 Removing the Options Class

Section 3: LOCATING ELEMENTS ON A WEBPAGE

Lecture 13 Locating Specific Elements Using Selenium

Lecture 14 Locating Elements By Classnames

Lecture 15 Locating Elements Using Pseudo-class Selectors

Lecture 16 Locating Elements Using their ID Attribute

Lecture 17 Locating Elements Using the Link Text Method

Lecture 18 Locating Elements Using the Tag Name Locator

Lecture 19 Locating Elements Using their Name Attribute

Lecture 20 Locating Elements Using Xpath

Lecture 21 Differences Between Relative and Absolute Xpath

Section 4: THE XPATH LOCATOR

Lecture 22 The Working of the Relative Xpath

Lecture 23 Formulating Xpath to Locate an Element

Lecture 24 Writing Relative Xpath for Identical Elements

Lecture 25 The Xpath Contains Method

Lecture 26 Xpath And & Or Expressions

Lecture 27 The Xpath Starts-with Function

Lecture 28 The Xpath Text Function

Lecture 29 Introduction to Xpath Axes

Lecture 30 Basic Definitios and Functions of Xpath Axes

Section 5: XPATH AXES

Lecture 31 Locating an Element Relative to Another

Lecture 32 Cont. Locating an Element Relative to Another

Lecture 33 Using Xpath Axes to Get Textual Content of Elements

Lecture 34 Combining Xpath Functions

Section 6: STRING FORMATTING

Lecture 35 Introduction to String Formatting

Lecture 36 Understanding String Formatting

Lecture 37 Using String Formatting to Generate an Entire String

Lecture 38 Using String Formatting With Float Numbers

Lecture 39 String Formatting With Date and Time

Lecture 40 Negating Numbers Using String Formatting

Lecture 41 Using String Formatting to Truncate a String

Lecture 42 Tabbing and Aligning Characters Using String Formatting

Lecture 43 String Formatting With Dictionaries and Keyword Arguments

Lecture 44 Using String Formatting With Functions

Lecture 45 Applying String Formatting to Scraping and Automation

Lecture 46 Cont. Applying String Formatting to Scraping and Automation

Section 7: PYTHON'S REGULAR EXPRESSION (REGEX)

Lecture 47 Removing Unwanted Characters From Output

Lecture 48 Understanding the Sub Method for Python's Regex

Lecture 49 Understanding Regex Metacharacters

Lecture 50 Cont. Understanding Regex Metacharacters

Lecture 51 Understanding Regex Special Sequences

Lecture 52 Understanding Regex Sets

Lecture 53 Regex Search Method

Lecture 54 Regex Split Method

Lecture 55 Unpacking Lists

Section 8: SIMULATING INPUT DEVICES

Lecture 56 Simulating Mouse Actions on Selenium

Lecture 57 Simulating Mouse Button Clicks on Selenium

Lecture 58 Drag and Drop and Highlighting Text Using Selenium

Lecture 59 Simulating Keyboard Actions on Selenium

Lecture 60 Highlighting, Copying and Pasting Content With Keyboard in Selenium

Section 9: BROWSER MANIPULATION

Lecture 61 Switching Browser Windows in Selenium

Lecture 62 Opening New Browser Windows and Tabs on Selenium

Lecture 63 Closing Tabs and Windows

Lecture 64 Maximizing a Browser

Lecture 65 Taking Screenshots Using Selenium

Lecture 66 Scrolling a Webpage Using Seleniium

Lecture 67 Closing a Browser Using Selenium

Section 10: HANDLING ERRORS IN SELENIUM

Lecture 68 Element Click Intercepted Exception

Lecture 69 No Such Element Exception

Lecture 70 Element Not Interactable Exception

Lecture 71 Delaying Element Visibility

Lecture 72 Waiting for Element Visibility in Selenium

Lecture 73 Waiting for Element Visibility Using Webdriverwait

Section 11: OPTIMIZING SELENIUM SCRIPT EXECUTION TIME

Lecture 74 Generating Random Numbers

Lecture 75 Clicking on Random Buttons

Lecture 76 Deriving Code Execution Time

Lecture 77 Creating Python Functions for Automation

Lecture 78 Threading in Python

Anyone with basic programming knowledge and is interested in automation of computing tasks and data scraping