VIDEO: How the Data Deluge is Changing Businesses

Video produced by Steve Nathans-Kelly

Modern architecture has evolved beyond the traditional data warehouse to include logical data warehouses, data lakes, distribution hubs, data catalogs, analytical sandboxes, and data science hubs, along with both self-service data preparation and BI.

At Data Summit 2018, Richard Sherman, managing partner, Athena IT Solutions, reflected on the need to build a data architecture for modern business intelligence and analytics that supports structured, unstructured, and semi-structured sources and hybrid integration and data engineering as well as analytical uses by casual information consumers, power users, and data scientists.

Technologies include databases (relational, columnar, in-memory, and NoSQL); hybrid data, application, and cloud integration; data preparation; data virtualization; descriptive, diagnostic, predictive, and prescriptive analytics; and on-premise and on-cloud deployments.

Sherman discussed the changes in data flowing into enterprises and where that data is stored.

Today, there is much more of an exchange of business to business data and business to consumer data. And, increasingly, enterprises don't own or manage the data as they used to do. No longer limited to just the four walls of the physical enterprise, now there is information that the business does not manage or govern; it just has to be blended in with its analytics. And of course a lot of that is being broadened by business people and data analysts, or business analysts without even the IT group knowing.

Second, there's a lot of local data that actually converts data into information that's useful for business. There is still lots of data in spreadsheets and unstructured documents, which are the business rules, the filters, the key performance indicators, the metrics, the hierarchies that are used for reporting and analysis and even for predictive analytics.

At the same time, the demand for analytics keeps getting stronger and stronger, as more and more people are used to getting that information that they can get on their iPhone, but they can't get necessarily about their company or about their company's sales.

To access more Data Summit 2018 videos, go to

Many PowerPoint presentations from Data Summit 2018 have been made available for review at

Data Summit 2019, presented by DBTA and Big Data Quarterly, is scheduled for May 21-22, 2019, at the Hyatt Regency Boston, with pre-conference workshops on May 20.