Streaming Data Pipeline using Confluent & Azure Platforms

Hands on course - Real Time Data Streaming Pipeline using Kafka, Azure Functions, Cosmos DB & Power BI from scratch

What you'll learn
- Develop understanding of confluent platform, be able to create Cluster, Topics, Managed Source & Sink connectors
- Develop hands on skills on Azure Function App, Azure Functions
- Able to create Cosmos DB Account, container, database and query cosmos db
- Able to setup Cosmos DB & Power BI Integration, Azure Function Sink connector and Azure Function Integration
- Able to setup Power BI to fetch data from cosmos and create a visual from data
- Develop understanding of creating & deploying Azure functions using Visual Studio Code

Requirements
- Be able to create Azure Account for hands on practice & follow along
- Be able to create Confluent Cloud Account for hands on practice & follow along
- Be able to install Power BI for hands on practice & follow along
- Be able to install Visual Studio Code for hands on practice & follow along

Description
In this hands-on course, participants will follow along step-by-step to build areal-time streaming data pipelinethat sends data fromConfluent KafkausingAzure Functions Sink connectortoAzure FunctionstoAzure Cosmos DBand finally creating operational report usingPower BI. This course is designed to provide practical, real-world skills by walking through each component of the architecture, ensuring that learners not only understand the concepts but also apply them directly in a cloud environment.

On the Azure Cloud Platform side, participants will gain experience working with several important services, includingAzure Functions, Cosmos No SQL DBandPower BI.The participant will also be exposed to logging, trouble shooting, monitoring and configuring these Azure Cloud Platform services. These services are essential for building secure, scalable, and reliable applications in the cloud.

On the Confluent Kafka side, learners will set up afully managed Kafka cluster, createtopicsfor message streaming, & configure afully managed Source Connectorto simulate real-world data ingestion, also configurefully managed Azure Functions Sink connector. This gives participants valuable exposure to enterprise-grade Kafka infrastructure without the overhead of managing the platform themselves.

By the end of this course, participants will have built a working, scalable pipeline, gained insights into cloud-native architectures, and acquired hands-on experience that can be directly applied to real-world projects or professional roles.

This course is suitable for budding Cloud Engineers, mid level Data Engineers, Product Owners, Product Mangers, Scrum Masters and Technology Leaders looking to get a hands-on experience of building a Real time Streaming Data Pipeline.

Who this course is for:
- Entry Level Cloud developers looking to build skills in Confluent Kafka, Azure & Power BI space
- Mid to Sr. Level Software Engineers looking to build data engineering skills by building Real time streaming data pipeline
- Product Managers looking to get hands-on experience with Real Time streaming data pipeline using Azure + Confluent + Power BI
- Technology Leaders looking to get hands-on experience with Real Time streaming data pipeline using Azure + Confluent + Power BI & gain appreciation for effort involved
More Info