Video produced by Steve Nathans-Kelly
At Data Summit 2019, Pythian VP Lynda Partner stressed the importance of regarding data projects as software projects, with attendant DevOps, DataOps, and ML Ops components.
"The consumers of data and data platforms aren't just via the data warehouse. Increasingly, now, what we're seeing is the data scientists who are showing up with their own tools that they want to use whether they're Jupyter notebooks or R or whatever products and they want to plug in," Partner said. "And they don't want to plug in to the data warehouse exclusively. They want access to all that raw data that data that they need for their models. So they're bringing their tools and hooking in. Apps are hooking in. You're starting to see mobile development that's using the data that's been integrated into the data platform."
DBTA’s next Data Summit conference will be held May 19-20, 2020, in Boston, with pre-conference workshops on Monday, May 18.
The key difference here is that while people are largely still the consumers of data in the platform, it's not restricted to people, Partner emphasized. "And, we need to start thinking about that data platform as an orchestrator of all the data in the enterprise to be delivered to a number of different systems. Now these are complicated systems, you know, they're complex, they're challenging, they're transforming data from hundreds of thousands of different places. They're not just data projects they're software projects and we have to start thinking about these as software products with DevOps and data ops and ML ops as part of it."
Many presenters have made their slide decks available on the Data Summit 2019 website at www.dbta.com/DataSummit/2019/Presentations.aspx.
To access the full video of Partner's presentation, "A Big Data Reality Check: A View from the Front Lines of Data Analytics," go to
https://datasummit.brightcovegallery.com/detail/videos/data-summit-2019-keynotes/video/6040469493001/sponsored-keynote-presented-by-pythian-group-inc.---a-big-data-reality-check:-a-view-from-the-front-lines-of-data-analytics?autoStart=true#links