Part 2: Handle Raw Audio And Image Pixels In C Using Ffmpeg

Turn FFMPEG commands into code using the C programming language. Handle FFMPEG Data Structures like a Pro Engineer.

What you'll learn

Learn advanced FFMPEG Data Structures i.e. AVPacket, AVFrame, Sws struct etc

Extract raw audio as 32 bit floats

Extract individual picture frames from video data

Convert grey images to color JPEGs using the libswscale and STB Image C library

Use the PPM image format to write pixels to file

Manipulate raw audio data using Audacity

Manipulate raw audio floats in unsigned 32 bit format

Use the C Int Types library to work on raw integer data

Requirements

Basic grasp of C programming

Description

**You can code on your phone or laptop. No installations necessary! Super accessible course thanks to Replit!**FFMPEG is an audio and video library used by Netflix, TikTok, Comcast and Disney engineers to manipulate audio and video. This is the second part of a series on using the FFmpeg in the C programming language.This section places emphasis on Freeing memory correctly and using Valgrind to investigate FFmpeg memory leaksExtracting pixels from images.Working with PPM and JPEG image formats in C.Finding raw audio samples and writing to a file stream.Video coding engineers earn a basic salary of 180k and companies like NETFLIX pay video coding engineers 900k total compensation.This video series introduces video coding to committed learners. We emphasize using the C programming language, not the command line. The goal is to make accessible video and audio coding to programmers who desire to work in HIGH-PAYING fields. All the code is written in Replit, an online IDE, to allow programmers to code alongside the instructor. Again, the instructor's goal is to make accessible video coding.This course introduces learners to the FFMPEG C API. Unlike courses that teach the command line, this series focuses on writing code in the C programming language.Students are taught -How to navigate the vast FFMPEG documentation. The data structures available to C programmers.Tips and Tricks professional C programmers use with FFMPEG.By the end of the 2nd part learners shall grasp these data structures:AVFormatContextAVPacketAVFrameAVFormatContextAVRationalAVMEDIA_TYPE

Overview

Section 1: Introduction

Lecture 1 Introduction

Section 2: Setting up your coding environment

Lecture 2 Installing FFmpeg on Replit using the Nix package manager

Lecture 3 Setting up Valgrind for Debugging

Lecture 4 Adding STB Image Library

Lecture 5 Compiling FFmpeg using GCC

Section 3: Handling Memory Leaks and Finding data streams

Lecture 6 Using Valgrind with FFmpeg

Lecture 7 Counting Data Streams using AVFormat Context

Section 4: Preparing the Video Stream and Audio Stream

Lecture 8 Intro to Advanced FFmpeg Data Structures

Lecture 9 Allocating memory for video data

Lecture 10 Finding the Video Stream

Lecture 11 Extracting Individual Video Packets

Lecture 12 Finding the Audio Stream and Extracting Audio Packets

Lecture 13 Freeing Memory Correctly

Section 5: Extracting Images in Grey and Red-Green-Brown color space

Lecture 14 Introduction to File Formats and Frames

Lecture 15 Decoding a Video Frame

Lecture 16 Viewing a Grey Frame

Lecture 17 Introduction to Color Spaces and Color Models

Lecture 18 Allocating memory for RGB Frames

Lecture 19 Adding Libswscale for Color Conversion

Lecture 20 Saving RGB Frame to PPM file format

Section 6: Extracting Raw Audio Samples from a video file

Lecture 21 Introduction to Audio Data

Lecture 22 Extracting Audio Samples as Floats

Lecture 23 Writing Audio Samples to File and Opening Audio in Audacity

Section 7: Additional Content : Adding JPEG Support in C using the STB Image library

Lecture 24 Adding JPEG support

Beginners who desire to learn the FFMPEG API in C,Programmers who want to get into the video and streaming industry,Teams that handle audio and visual content