Ep 23 - The Three Eras Of Data Engineering

28/09/2023 36 min
Ep 23 - The Three Eras Of Data Engineering

Listen "Ep 23 - The Three Eras Of Data Engineering"

Episode Synopsis

Sean and Paul talk the three eras of data engineering teams move through as they get more mature with data processing. We unpack the kinds of metadata required at each stage, and how realistic it is to build a system that processes data in incremental packets instead of full reductions.