Pat Patterson

Pat Patterson is technical director at StreamSets.

The StreamSets DataOps platform enables the agile design and operation of continuous data movement architectures that connect traditional and big data sources to analytics platforms and applications. At its core is StreamSets Data Collector, an open source data movement engine with well over 2 million downloads.

On top of this “open core” are commercial products that enable collaborative design, deployment and runtime management of data movement architectures at enterprise scale.

Articles by Pat Patterson

Data architectures are becoming more complex and changing more frequently, requiring that a new operational mindset be applied to data management. In particular, automating the building and maintenance of data pipelines is needed, as is instrumenting and continuously monitoring pipeline performance to ensure reliability and quality for data consumers. We call this practice "DataOps."

Posted May 16, 2019