Data Match, AgileData Engineering Pattern #7 - Episode #75

05/09/2025 10 min Episodio 75
Data Match, AgileData Engineering Pattern #7 - Episode #75

Listen "Data Match, AgileData Engineering Pattern #7 - Episode #75"

Episode Synopsis

Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the Data Match.
 
The Data Match pattern provides an automated, granular comparison capability to efficiently identify and report discrepancies between two datasets, moving from row counts to specific data values.
This 'data diff' solution transforms hours of manual data reconciliation into minutes by optimising comparisons for cloud analytics databases like BigQuery, serving as a support feature for on-demand exception handling rather than a continuous trust rule.
 
An AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.
 
If you want a copy of the pattern template head over to:
https://agiledata.substack.com/i/172820886/pattern-name


Discover more  AgileData Engineering Patterns over at https://agiledata.substack.com/s/agiledata-engineering-patterns
 
If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
 
Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser |  Deezer | Podcast Addict | 



Buy the Green Book now!



 
Simply Magical Data Ways of Working

More episodes of the podcast Agile Data N’ Info