The Next Wave of Big Data Technologies

Fueled by the growing demand for data-driven insights, as well as the explosion of new data sources and formats, innovative big data technologies continue to expand. While the long-trusted RDBMS still reigns supreme in most organizations, the surging force of data from social media, mobile devices, IoT, and other sources, as well as the availability of additional options for data storage and processing, means that there is plenty of room for disruptive new approaches.

Fueled by the growing demand for data-driven insights, as well as the explosion of new data sources and formats, innovative big data technologies continue to expand.

The Summer issue of Big Data Quarterly magazine is now available for download.

According to a recent Unisphere-AWS survey, over the next 3 years, 60% of IT managers, DBAs, and C-level executives expect to store more data in the cloud than on-premise. In addition, the use of NoSQL platforms, including document, graph, columnar, and in-memory, which are still in the relatively early days of adoption, will also see an increase, spurred by new applications for the technology and an increased availability of skills and expertise. At this point, more than half of the respondents have been running NoSQL applications for just 2 years or less, the survey found.

IoT, blockchain, and automation are some of the newer technologies expected to loom large.

By 2030, Cisco projects that 500 billion devices with sensors will connect to the internet as part of IoT, the network of linked devices that collect data, interact with the environment, and communicate.

While still in the early stages, blockchain is one of the most talked-about new technologies. A recent SAP study found that organizations are optimistic about its potential benefit for a range of business challenges—with supply chain and IoT segments showing particularly promising use cases.

Automation, another key trend tech on the horizon, will also play a greater role in the future, according to a Dell Technologies survey which looked at the changing relationship between humans and emerging technologies by 2030. The survey found that 82% of business leaders expect their workforce and machines to work as integrated teams within 5 years.

The next wave of new enterprise technology—as well as the skills needed to maximize them—is explored from a variety of viewpoints in the Summer issue of Big Data Quarterly magazine.

Craig S. Mullins provides an overview of the key technologies for a strong enterprise foundation, ranging from microservices and DevOps to AI and machine learning. “Technology is constantly changing, and IT architects need to keep up with modern developments to ensure that their companies are achieving the best possible return on their IT investment,” notes Mullins.

“The successful enterprise architects quickly grasp, structure, and analyze information to solve imminent challenges, with a focus on continuous assessment of systems and processes,” adds André Christ, in his article on the key traits of the enterprise architects of the future.

In addition, Nathan Zenero drills down on the attractive properties of blockchain and why organizations should consider using it, while Philip On reflects on the convergence of transactional and analytical data platforms which some analysts have dubbed “Translytical Data Platform” or “Hybrid Transactional/Analytical Processing (HTAP).”

Looking at IoT, another relatively new technology likely to result in great changes to decision making, regular BDQ columnist Bart Schouw examines the seven characteristics of successful IoT projects. As IoT matures, he says, there is the need to start sharing information about what works and what doesn’t and where  to start the IoT or IIoT journey

And, there are many more articles in the Summer issue of Big Data Quarterly magazine on the use of new big data technologies for better decision making and agility. To stay on top of the latest trends, research, and product news, be sure to visit


Subscribe to Big Data Quarterly E-Edition