Introduction To Data Mesh

Generate value from data by adopting evolutionary mindset in a complex, volatile and constantly-changing environment

What you'll learn
Understand why current data architectures are not scalable
Know the shifts data mesh introduces to respond gracefully to change and complexity
The promise and principles of data mesh
Practical examples and tips on implementing the data mesh
Requirements
Being open to the ideas and new ways of solving the problem of analytical data management
An inquisitive mind
No programming experience is needed
No prior industry experience is needed
If you have seen, built or experienced any data pipeline before, you’ll be able to relate, but that is not a requirement for this course
Description
A monolithic architecture, technology, and organizational structure are not suitable for analytical data management of large-scale and complex organizations.Many enterprises are investing in their next generation data lake, with the hope of democratizing data at scale to provide business insights and ultimately make automated intelligent decisions. Data platforms based on the data lake architecture have common failure modes that lead to unfulfilled promises at scale. To address these failure modes we need to shift from the centralized paradigm of a lake, or its predecessor data warehouse. We need to shift to a paradigm that draws from modern distributed architecture: considering domains as the first class concern, applying platform thinking to create self-serve data infrastructure, and treating data as a product.We've started to see returns of investment over data to plateau, and data teams getting stressed with the challenges of generating value from the data.Data mesh is that shift in the mindset which aims and promises to:Respond gracefully to change and complexitySustain agility in the face of growthIncrease value of data over costThis illustrative course gives you finer understanding of the principles of data mesh, along with the practical examples and tips on implementing the data mesh.We'll also look into one real world situation as how the data culture in an organisation got transformed with data mesh.

Overview

Section 1: Prerequisite

Lecture 1 Who this course is for

Lecture 2 Prerequisite

Section 2: Resources

Lecture 3 Google Slides

Section 3: Traditional Data Architecture

Lecture 4 Evolution of Data Architectures

Lecture 5 Unchallenged Assumptions

Section 4: Need for Data Mesh

Lecture 6 The Inflection Point

Lecture 7 Drivers for Data Mesh

Section 5: MyMusic Organisation

Lecture 8 MyMusic

Lecture 9 MyMusic Data Goal

Lecture 10 MyMusic before Data Mesh

Lecture 11 MyMusic Data Culture before Data Mesh

Lecture 12 MyMusic Data Culture Reflections

Section 6: What is DataMesh

Lecture 13 What is Data Mesh

Lecture 14 Principles of Data Mesh

Lecture 15 Data Mesh Model

Section 7: Principle of Domain Ownership

Lecture 16 Principle of Domain Ownership

Lecture 17 Data Domain Archetypes

Lecture 18 Transition to Domain Ownership

Section 8: Principle of Data as a Product

Lecture 19 Principle of Data as a Product

Lecture 20 Baseline Usability Attributes

Lecture 21 Transition to Data as a Product

Section 9: Principle of Self Serve Data Platform

Lecture 22 Principle of Self Serve Data Platform

Lecture 23 Comparison with Existing Setup

Lecture 24 Objectives of Self Serve Data Platform

Lecture 25 Transition to Self Serve Data Platform

Section 10: Principle of Federated Governance

Lecture 26 Principle of Federated Governance

Lecture 27 Applying Systems Thinking

Lecture 28 Applying Federation to Governance Model

Lecture 29 Applying Computation to Governance Model

Lecture 30 Transition to Federated Governance

Section 11: Interplay of Data Mesh Principles

Lecture 31 Interplay of Data Mesh Principles

Lecture 32 Shifts Introduced by Data Mesh Principles

Section 12: After the Inflection Point

Lecture 33 After the Inflection Point

Lecture 34 Respond Gracefully to Change and Complexity

Lecture 35 Sustain Agility in the Face of Growth

Lecture 36 Increase Value of Data over Cost

Lecture 37 Data Mesh Outcomes for Organisations

Section 13: Data Mesh Outcomes for Organisations

Lecture 38 MyMusic Data Goal with Data Mesh

Lecture 39 Data Mesh outcomes in MyMusic

Section 14: Congratulations

Lecture 40 Bye!

Data Scientists,Data Engineers,Data Leaders,Data Managers,Data executives,Application Engineers,Analytical Data Users,Infrastructure Product Owners,Infrastructure Architects,Infrastructure Engineers,Data Governance Engineers