Apache Kafka For Spring Boot Microservices

Learn how to build event-driven Spring Boot Microservices using Apache Kafka.

What you'll learn

Apache Kafka for Microservices

Create Event-Driven Microservices

Work with Kafka CLI

Run Multiple Kafka Servers in a cluster

Work with Kafka Consumers in Java

Work with Kafka Producers in Java

Handle and recover from errors

Requirements

Basic knowledge of Java

Basic knowledge of Spring Boot

Description

In this video course, you will learn how to use Apache Kafka to build Event-Driven Spring Boot Microservices. This course is designed for beginners and will start from the basics of Microservices and Apache Kafka. You will learn: - What is Apache Kafka, and how to work with it using Command Line Interface(CLI), You will learn how to use Kafka CLI to : - Start multiple Apache Kafka servers in a cluster,- Work with Kafka Topics, - Work with Kafka Producer to produce messages,- Work with Kafka Consumer to consume messages. You will learn how to create a basic Spring Boot Microservice that acts as a Kafka Producer. While working with this Microservice you will learn: - How to send Kafka messages synchronously, - How to send Kafka messages asynchronously,- How to work with Acknowledgements, Retries, Delivery and Request timeouts. You will also learn how to create Kafka Consumer Spring Boot Microservice. While creating Consumer Microservice you will learn to: - Consume messages from Kafka topic, - Handle and recover from errors, - Work with Kafka Dead Letter Topic(DLT),- Configure multiple consumer microservices to work as a group(Consumer Groups).All from the very beginning, to help you learn how to create Event-Driven Microservices with Apache Kafka and Spring Boot.

Overview

Section 1: Introduction to Apache Kafka

Lecture 1 Introduction

Lecture 2 What is Microservice?

Lecture 3 Microservice vs Monolithic application

Lecture 4 Microservices Communication

Lecture 5 Event-Driven Architecture with Apache Kafka

Lecture 6 Apache Kafka for Microservices

Lecture 7 Messages and Events in Apache Kafka

Lecture 8 Kafka Topic and Partitions

Lecture 9 Ordering of Events in Apache Kafka

Section 2: Apache Kafka Broker(s)

Lecture 10 What is Apache Kafka broker?

Lecture 11 Apache Kafka broker: Leader and Follower roles. Leadership balance.

Lecture 12 Download Apache Kafka

Lecture 13 Start single Apache Kafka broker with KRaft

Lecture 14 Multiple Kafka broker: Configuration Files

Lecture 15 Multiple Kafka broker: Storage folders

Lecture 16 Starting multiple Kafka broker with KRaft

Lecture 17 Stopping Apache Kafka brokers

Section 3: Kafka CLI: Topics

Lecture 18 Introduction to Kafka Topic CLI

Lecture 19 Creating a new Kafka topic

Lecture 20 List and describe Kafka topics

Lecture 21 Deleting a Topic

Lecture 22 Apache Kafka Topic: Summary PDF document.

Section 4: Kafka CLI: Producers

Lecture 23 Introduction Kafka Producer CLI

Lecture 24 Producing a Message without a Key

Lecture 25 Send message as a Key:Value Pair

Lecture 26 Apache Kafka CLI: Producer. Summary PDF document

Section 5: Kafka CLI: Consumers

Lecture 27 Introduction to Kafka Consumer CLI

Lecture 28 Consuming messages from Kafka topic from the beginning

Lecture 29 Consuming new messages only

Lecture 30 Consuming Key:Value pair messages from Kafka topic

Lecture 31 Consuming messages in order

Lecture 32 Apache Kafka CLI: Consumer. Summary PDF document

Section 6: Kafka Producer - Spring Boot Microservice

Lecture 33 Source code

Lecture 34 Introduction to Kafka Producer

Lecture 35 Kafka Producer - Introduction to synchronous communication style

Lecture 36 Kafka Producer - A use case for asynchronous communication style

Lecture 37 Creating a new Spring Boot project

Lecture 38 Kafka Producer configuration properties

Lecture 39 Creating Kafka Topic

Lecture 40 Run Microservice to create a new topic

Lecture 41 Creating Rest Controller

Lecture 42 Creating a Service class

Lecture 43 Creating an Event class

Lecture 44 Kafka Producer: Send Message Asynchronously

Lecture 45 Kafka Asynchronous Send. Trying how it works.

Lecture 46 Kafka Producer: Send Message Synchronously

Lecture 47 Kafka Producer: Handle Exception in Rest Controller

Lecture 48 Kafka Producer: Logging Record Metadata Information

Lecture 49 Kafka Synchronous Send. Trying how it works.

Section 7: Kafka Producer: Acknowledgements & Retries

Lecture 50 Source code

Lecture 51 Kafka Producer Acknowledgement

Lecture 52 Kafka Producer Retries

Lecture 53 Configure Producer Acknowledgments in Spring Boot Microservice

Lecture 54 The min.insync.replicas configuration

Lecture 55 Trying how the min.insync.replicas works

Lecture 56 Producer Retries

Lecture 57 Trying how Producer Retries work

Lecture 58 Delivery & Request Timeout

Lecture 59 Trying how Delivery & Request Timeout works

Section 8: Kafka Consumer - Spring Boot Microservice

Lecture 60 Source code

Lecture 61 Introduction to Kafka Consumer

Lecture 62 Creating a new Spring Boot project

Lecture 63 Kafka Consumer Configuration Properties

Lecture 64 Kafka Consumer with @KafkaEventListener and @KafkaHandler annotations

Lecture 65 Creating the "core" module

Lecture 66 Adding "core" project as a dependency

Lecture 67 @KafkaHandler: Trying how it works

Lecture 68 Kafka Consumer Spring Bean Configuration

Lecture 69 Kafka Listener Container Factory

Lecture 70 Trying if Kafka Consumer Bean Configuration works

Section 9: Kafka Consumer - Handle Deserializer Errors

Lecture 71 Source code

Lecture 72 Introduction to Error Handling in Kafka Consumer

Lecture 73 Causing the deserialization problem

Lecture 74 Kafka Consumer ErrorHandlingDeserializer

Lecture 75 Trying how ErrorHandlingDeserializer works

Section 10: Kafka Consumer - Dead Leter Topic(DLT)

Lecture 76 Source code

Lecture 77 Introduction to Deal Letter Topics in Kafka

Lecture 78 Handle errors: The DefaultErrorHandler and DeadLetterPublishingRecoverer classes

Lecture 79 Create and Configure KafkaTemplate object

Lecture 80 Dead Letter Topic: Trying how it works

Section 11: Kafka Consumer - Exceptions and Retries

Lecture 81 Source code

Lecture 82 Introduction to Exception handling in Kafka consumer and retries

Lecture 83 Creating retryable and not retryable exceptions

Lecture 84 Configure DefaultErrorHandler with a list of not retryable exceptions

Lecture 85 Trying how not retryable exception works

Lecture 86 Register RetryableException and define wait time interval

Lecture 87 Throwing a RetryableException

Lecture 88 Overview of a destination Microservice

Lecture 89 Trying how retry works

Section 12: Kafka Consumer - Multiple Consumers in a Consumer Group

Lecture 90 Source code

Lecture 91 Introduction to Kafka Consumer Groups

Lecture 92 Rebalancing and Partition Assignment in Apache Kafka

Lecture 93 Assigning Microservice to a consumer group

Lecture 94 Starting up more Microservices

Lecture 95 Trying how partitions assignment works

Lecture 96 Multiple consumers consuming messages from Kafka topic

Java developers interested to learn about Apache Kafka,Java developers interested to learn how to create event-driven Microservices with Apache Kafka