Automation In Etl /Data Testing

Using and simple and sample ETL Project

What you'll learn

Automate your ETL Testing Validation Steps

Reduce the efforts for Retesting and (Non) Regression Testing

Save time for finding Regressions and Retesting

Reuse of same Testing Framework for other ETL Testing Projects

Requirements

ETL Testing

Python

Pytest

SQL

Description

The course is on a basic idea of automation in ETL Testing or Data Testing. We perform Retesting and (Non) Regression tests during a project or release. We perform same set of validation steps to ensure there are no regression introduced due to recent changes. If one has the idea on automating those repetitive task, it helps a lot to save our efforts and time.I have used a simple ETL project to understand the automation steps. In this course, I have used Python and Pytest to organize the test cases. The project used is just to give an idea how can we connect to actual requirement when we perform actual testing during our professional work. The project is not ideal and actual ETL project can vary to a greater extent.To validate the business rules, I have used SQL queries in the course. Few frameworks are created to use it for further test cases and execution. Most of the test cases include here are not exhaustive and are just for understanding purpose. Please do not take it as a reference for ETL Testing. Only take away from this course is how to automate your same set of validation steps.It is recommended to have experience on ETL Testing and basic knowledge of SQL, Python and Pytest. However, if you don't have much experience on these, it won't be very difficult to understand it. I have tried to make the course as simple as possible.

Overview

Section 1: Introduction

Lecture 1 Introduction

Section 2: Connection to Database and Creating a Framework

Lecture 2 Connection to the Database MS SQL using Python

Lecture 3 Creation of the Framework to run the sql queries

Section 3: Understanding the Project Requirement

Lecture 4 Project Requirement through Mapping Document

Section 4: Creation and Execution of Test Cases

Lecture 5 Creating and Executing First Test Case

Lecture 6 Parametrizing the test cases

Lecture 7 Validation for Presence of records in the tables

Lecture 8 Validation for Column Names of the tables

Who are new to Automation in ETL/Data Testing,Have an idea for automation in ETL/Data Testing,Perform same set of validation steps in ETL/Data Testing,Run same set of SQL queries,Want to create automation test suite in ETL/Data Testing but lack the idea