Data architectures are becoming more complex and changing more frequently, requiring that a new operational mindset be applied to data management. In particular, automating the building and maintenance of data pipelines is needed, as is instrumenting and continuously monitoring pipeline performance to ensure reliability and quality for data consumers. We call this practice "DataOps."
Posted May 16, 2019