09-15, 13:00–13:30 (Europe/Amsterdam), Bar
This talk delves into the topic of minimizing the Data Mesh mess. We will explore practical strategies and a data platform architecture for effectively governing and managing data within a decentralized data setup. We can balance decentralization and maintaining data quality by imposing a few constraints. The takeaways of this talk are drawn from the data platform at Enza Zaden.
The concept of Data Mesh has gained significant attention in recent years, offering a promising approach to managing data at scale. However, as organizations embrace the decentralized approach to data, they often encounter unforeseen challenges and potential chaos that can arise within a Data Mesh implementation.
This talk delves into the topic of minimizing the Data Mesh mess. We will explore practical strategies and a data platform architecture for effectively governing and managing data within a decentralized data setup. We can balance decentralization with maintaining data quality by imposing a few constraints.
During the session, we will address key questions and considerations such as:
- What constraints can we enforce to increase the quality of shared data while remaining adaptable to the data teams?
- How can we effectively manage data ownership, access controls, and security across diverse data domains?
- What are the recommended approaches for metadata management?
- How can we modify the level of flexibility and ownership for data teams depending on their level of experience and readiness?
Drawing from a real-world data platform at Enza Zaden (https://www.enzazaden.com/), we will discuss successful strategies and best practices for taming the inherent complexity of a Data Mesh. This talk aims to provide practical insights and actionable steps to help you create a data platform that minimizes the Data Mesh mess.
No previous knowledge expected
Cor improves business processes with data.
With a background in physics and an MSc in data science, he is well-versed in various tools and practices. Cor understands, on a fundamental level, the techniques that he applies. He converts questions into automated and optimized processes. Simply put: Cor believes that actions lead to insights more often than insights lead to actions.
After laying out a solid data engineering foundation, Cor applies AI techniques to give every project or product an unrivaled edge. He loves to automate solutions to turn your most daunting business challenges into a walk in the park.