Learn Advance Unix/Linux : File Processing Using Awk & Sed

Basic to Advance AWK Command | File Processing using SED | Advance Search using Grep and egrep | Cut Command

What you'll learn
Get expertise in File Processing using AWK Commands
Realtime Usage and Implementation of AWK Commands
Realtime implementation of large files search operations using Grep and eGrep
File Data Separation using SED and CUT commands
Practical and Theoretical Interview Question with practical scenario
Requirements
Good to have understanding of Log Files & Other files generating on Unix or Linux Server Machine
Basic understanding of file processing in Unix
Basic knowledge of Unix/ Linux commands
Description
*Monthly Update*Oct 2021 : Added/ Updated Grep and Egrep VideosApr 2021 : Updated  AWK VideosJan 2021 : Added Questions & ExercisesAWK & SEDMany UNIX utilities generates rows and columns of information. AWK is an excellent tool for processing these rows and columns, and is easier to use AWK than most conventional programming languages. It can be considered to be a pseudo-C interpreter, as it understands the same arithmetic operators as C. AWK also has string manipulation functions, so it can search for particular strings and modify the output. AWK also has associative arrays, which are incredible useful, and is a feature most computing languages lack. Associative arrays can make a complex problem a trivial exercisesAWK Coverage   Basic to Advance AWKEnvironment Setup with Test DataBasic Operations : Fetch One or Multiple Columns DataBasic Operations : Fetch One or Multiple Columns Data with SeparatorConditionally Fetch Data using Logical OR and Logical ANDCondition Handling with AWK CommandsAWK Looping AWK BlocksSave AWK Results to the fileSED CoverageSED IntroductionDisplay one or Few lines in OutputDisplay Data by Search conditionsSkip Data to display in outputFind and Replace DataSearch |  Insert | Update and Delete DataSearch Data using GREP commandsSearch Data in one or Multiple FilesSearch Data in All filesSearch data with case or ignoring caseSearch data with surrounding wordsAdvance Search ConditionCut CommandsCut ColumnsCut Range of ColumnsCut by characters

Overview

Section 1: Understand File Processing using AWK Commands

Lecture 1 Introduction to AWK

Lecture 2 ** Course Architecture : Must for Everyone **

Lecture 3 Setup Environment for Practice | Setup Virtual machine on your system

Lecture 4 Environment Setup

Lecture 5 Setup Test Data

Section 2: Basic Operations : Fetch Colum Data by giving Separators

Lecture 6 AWK Command - Select Single Column | Multiple Columns | All Columns

Lecture 7 AWK - Select columns data from file using Separators

Lecture 8 AWK - Fetch data by giving row number OR Range of rows

Lecture 9 AWK - Save Command Result to File

Section 3: Conditionally Select Data

Lecture 10 AWK - Conditionally select data

Lecture 11 AWK - Conditionally Select data with logical AND

Lecture 12 AWK - Conditionally Select data with logical OR

Lecture 13 AWK - Conditionally Select data | Check Substring in Record & Column

Lecture 14 IMPORTANT–––- Task for Students ––- : Find Records by matching conditions

Section 4: Search & Select

Lecture 15 AWK : Search text at the start

Lecture 16 AWK : Search text at the end

Lecture 17 IMPORTANT–––- Task for Students ––––-: Search data as SubString

Lecture 18 IMPORTANT–––- Task for Students ––- : Find in Row or Specific Column

Section 5: IF-Else Conditions

Lecture 19 AWK : Condition check using IF

Lecture 20 AWK : Condition check using IF-ELSE

Lecture 21 AWK : Condition check using IF-ELSE IF -ELSE

Lecture 22 IMPORTANT–––- Task for Students ––- : Search and Change Data

Section 6: Blocks & Loops

Lecture 23 AWK : Begin Block

Lecture 24 AWK : End Block

Lecture 25 AWK : While Loop

Lecture 26 AWK : For Loop

Lecture 27 AWK : Store comamnd Result into variable

Lecture 28 AWK : Execute code without file name

Lecture 29 AWK : Split file with complete data

Lecture 30 AWK : Split file with Selective data

Lecture 31 Find String Length

Lecture 32 Display string in upper and lower case

Lecture 33 Replace values

Lecture 34 Find Index and SubString

Lecture 35 What is printf : Basic formatting

Lecture 36 Printf : Basic formatting : Tab and Pipe symbol

Lecture 37 Printf: String formatting

Lecture 38 Printf: Number formatting

Section 7: SED : Stream Editor

Lecture 39 What is SED

Lecture 40 SED : Display Specific Line

Lecture 41 SED : Display Last Line and Range of Lines

Lecture 42 SED : Skip lines in result

Lecture 43 SED : Display lines by searching a word

Lecture 44 SED : Save Result to File

Lecture 45 SED : Substitute data in File

Lecture 46 SED : Substitute/ Replace multiple data

Lecture 47 SED : Substitute/ Replace data by checking some conditions

Lecture 48 SED : Delete data from file

Lecture 49 SED : Insert data into file

Section 8: Search Data in a File | Different Options to Search content in a file

Lecture 50 What is Grep | Search data in 1 file

Lecture 51 Search data in more than 1 files

Lecture 52 Search data in all files of current directory

Lecture 53 Search data by ignoring case

Lecture 54 Search Data : Display Line number

Lecture 55 Search Data : Display File Name

Lecture 56 Search Data : With exact word

Lecture 57 Search Data : By ignoring given text

Lecture 58 Search Data : Count number of matches

Lecture 59 Search Data : Display surrounding lines

Lecture 60 Search Data : Multiple Content

Lecture 61 Search Multiple data with egrep

Lecture 62 IMPORTANT–––- Task for Students ––- : Search Lines having text

Lecture 63 IMPORTANT–––- Task for Students ––- : Search Count

Lecture 64 IMPORTANT–––- Task for Students ––- : Search specific count only

Section 9: File processing using CUT Command

Lecture 65 What is Cut command | Find character on specific position

Lecture 66 Cut command : Display specific column

Lecture 67 Cut command : Display range of columns

Lecture 68 Cut Command : Skip specific column

Section 10: VIM Editor Commands

Lecture 69 Make Changes | Close file without saving

Lecture 70 View any command help

Lecture 71 Save content of file

Lecture 72 Insert data to file

Lecture 73 Insert data in new line

Lecture 74 Delete data from file

Lecture 75 Append data to file

Lecture 76 Search data in File

Section 11: Record Everything you perform on Terminal

Lecture 77 Script Command

Lecture 78 Script Command Options

Section 12: Commands Must for All…

Lecture 79 All Uses of CAT command

Lecture 80 Data Backup commands

Lecture 81 Change File Mode

Lecture 82 Editors

Lecture 83 User Commands

Lecture 84 Set Environment Variables

Lecture 85 Network Command

Section 13: Shell Scripting Basics

Lecture 86 Shell Basics

Lecture 87 First Shell Script

Lecture 88 Variables in Shell scripts

Lecture 89 User interaction for inputs

Section 14: Drill down shell script

Lecture 90 Command Line Arguments

Lecture 91 Condition Handling - If else

Lecture 92 Condition Handling - Multiple conditions

Lecture 93 Condition Handling - Logical AND/OR

Lecture 94 For Loop

Lecture 95 Functions

Software Developers wants to perform backend activities,Software Testing working in Back end testing,Big Data, Artificial Intelligence, Machine Learning Aspirants