“Every company is a data company,” Keith Alsheimer, head of marketing, Unravel Data during his Data Summit 2022 presentation. Alsheimer and Chris Santiago, VP solutions engineering, Unravel Data, discussed DataOps and how it can solve big data problems during the presentation.
The annual Data Summit conference returned in-person to Boston, May 17-18, 2022, with pre-conference workshops on May 16.
The demand for talent exceeds supply and the area with the greatest need is data analytics, Alsheimer said. He cited several studies including a Linkedin Survey.
DataOps is the answer to this problem, Alsheimer said. Companies are discovering that migrating to the cloud is more difficult than it seems, he explained. More than 50% of companies are struggling with a lack of visibility across the environment, according to a recent study done by the company.
DataOps tools are evolving, Santiago explained. Web App tools are not built for data stacks. Though those solutions are great for general purpose monitoring for specific services, it doesn’t all users to see through an entire data stack.
Modern data apps are fundamentally different than web apps. It requires different capabilities to tackle the modern data stack, Santiago noted. DataOps observability looks at completely different metrics at the app level as well as the pipeline level.
Beyond observability, optimization and governance are important factors within DataOps. Full-stack observability correlates data from all systems to provide a clear picture of what happened.
AI-driven recommendations pinpoint exactly where—and how—to optimize. Santiago presented a few use cases where DataOps delivered improved results for companies.
“At the end of the day, modern data stacks are totally different,” Santiago said. “We need to be able to take in multiple different data sources and bring it into one pane of glass to make sense of it.”
Many Data Summit 2022 presentations are available for review at https://www.dbta.com/DataSummit/2022/Presentations.aspx.