Data Mesh

Push Data into Data Products you own this product

This project is part of the liveProject series Build a Small Dockerized Data Mesh
prerequisites
intermediate Python • basic pandas
skills learned
build a self-serve data platform • build a small data catalog • consume data inside a data mesh • store data products
Sven Balnojan
1 week · 6-8 hours per week · INTERMEDIATE
try now

placing your order...

Don't refresh or navigate away from the page.
liveProject This project is part of the liveProject series Build a Small Dockerized Data Mesh liveProjects give you the opportunity to learn new skills by completing real-world challenges in your local development environment. Solve practical problems, write working code, and analyze real data—with liveProject, you learn by doing. These self-paced projects also come with full liveBook access to select books for 90 days plus permanent access to other select Manning products. $19.99 $29.99 you save $10 (33%)
Push Data into Data Products (liveProject) added to cart
continue shopping
adding to cart

choose your plan

pro

monthly
annual
$24.99
$249.99
only $20.83 per month
  • share your subscription with one other person
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Push Data into Data Products project for free

team

monthly
annual
$49.99
$499.99
only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Push Data into Data Products project for free
Look inside

Messflix Inc., a movie and TV-show streaming platform, is implementing a data mesh. So far, it has a self-serve data platform prototype where development teams can register their domain data products. As a consultant, your task is to build on that basic platform prototype with additional functionality: You’ll write a script in Python that will enable the development teams to push fresh data into their existing data products, write a function that adds support for versioned data, and implement a function that automatically calculates specific metadata (like row count and latest timestamp), then prints it to the screen. When you’re finished, you’ll have built a well-functioning, feature-rich, self-serve data platform, and be familiar with the requirements data-producing and data-consuming teams face daily and how to fulfill them.

This project is designed for learning purposes and is not a complete, production-ready application or solution.

book resources

When you start your liveProject, you get full access to the following books for 90 days.

project author

Sven Balnojan

Sven Balnojan is a data technologist and product-person focused on helping the world extract more value from the exponentially growing amount of data. He’s passionate about all things data, including machine learning, AI, and business intelligence. As a manager of internal data teams, he’s been integral in easing their transitions from being a service-oriented to platform-oriented data team. He enjoys getting his hands dirty as a data developer, whether in the field of machine learning, data engineering, or data DevOps.

For his PhD in mathematics, Sven wrote a thesis in the field of singularity theory. He’s the co-author of Manning’s Data Mesh in Action and author of the Three Data Point Thursday newsletter. He blogs on datacisions.com and makes appearances in various online talks.

prerequisites

This liveProject is for data architects, developers, and data team members who want to understand the workings of a data mesh. To begin these liveProjects, you’ll need to be familiar with the following:

TOOLS
  • Intermediate Python
  • Basic Docker
  • Basic Bash

you will learn

In this liveProject, you’ll learn simple techniques for publishing data products.

  • Platform thinking (keeping in mind the goal of reducing the work required of users of the platform)
  • Product thinking (understanding the data-producing side as well as the data-consuming side)
  • The concept of a domain data product
  • Load data from a data platform with pandas

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.
RECENTLY VIEWED