Big Data Quarterly Articles

For the past year, my team has been exploring the value that generative AI can add to Internet of Things (IoT) platforms. The reason is simple: as IoT continues to evolve, addressing challenges related to mass connectivity and device management, the need for a forward-looking perspective on the future of IoT platforms becomes more apparent. Use cases like predictive maintenance indirectly highlight this need for advanced functionality. While device management remains fundamental, enabling such use cases requires practical capabilities such as machine learning and AI.

Posted February 15, 2024

UnifyCloud, a leading provider of cloud modernization and transformation solutions, is expanding its CloudAtlas platform to include comprehensive support for Amazon Web Services (AWS). With this enhancement, UnifyCloud now offers a unified solution for cloud transformation across all three major cloud platforms—Azure, Google Cloud, and AWS.

Posted February 14, 2024

VAST Data, the AI data platform company, is partnering with Run:ai, a leader in compute orchestration for AI workloads, to redefine AI operations at scale by offering a full-stack solution encompassing compute, storage, and data management. Together, VAST and Run:ai are addressing the critical needs of enterprises embarking on large-scale AI initiatives, according to the company.

Posted February 13, 2024

Cockroach Labs is releasing the next version of its signature platform, CockroackDB, introducing new tools and capabilities such as a live database migration service, enhanced disaster recovery, and increased performance through smarter data distribution. Other new CockroachDB 23.2 features include simplified migrations with read committed isolation; physical replication for fast recovery from cloud failures; and added support for Stored Procedures/UDFs.

Posted January 18, 2024

DigitalOcean, the developer cloud optimized for startups and growing digital businesses, is offering the virtualized availability of NVIDIA H100 Tensor Core GPUs on its Paperspace platform, providing access to one of the market's powerful GPUs. According to the company, this provides startups and growing digital businesses with state-of-the-art infrastructure crucial for developing the next generation of artificial intelligence/machine learning (AI/ML) applications.

Posted January 18, 2024

In 2005, "The Terminator," also known as Arnold Schwarzenegger and later "The Governator," uttered the famous catchphrase "I'll be back." Twenty years later, reflecting on the slogan "I'll be back," it could easily be applied to the current legal battle and decades-long saga between Rimini Street and Oracle. Yet it should not be surprising that this battle continues. More importantly, as this battle rages on, your right to use third-party support alternatives from any vendor is under fire.

Posted January 18, 2024

If you already know what your business will look like a year from now—what the market demand will be, how your customers will respond, and the technologies that will be available to serve them—then you can stop reading now. For the rest of you who struggle with delivering the right networking solutions and applications—at the right time, in the right place, and at the best cost—read on!

Posted January 17, 2024

Generative AI (GenAI) and large language models (LLMs) burst into the corporate and public consciousness this past year like confetti from a carnival cannon or the glitter from a child's art project. Beyond splashy headlines, discussions of imminent opportunity and threat permeated into every organizational crevasse overnight, or so it seemed from the general public's point of view. And while the technical underpinnings were not all that new, the resultant capabilities of these gargantuan models certainly surprised most.

Posted January 17, 2024

FusionAuth, the customer identity platform built for developers by developers, is enhancing performance and scalability for webhook signing and search APIs, eliminating barriers for large-size customers by delivering frictionless authentication and user management for any application at any scale.

Posted December 20, 2023

Data, the potent fuel powering the AI-driven enterprise, is always on the move, as are the tools, technologies, and techniques being employed to manage and deliver it. With the intense emphasis on AI and machine learning these days, it's urgent to ensure that data is available, timely, accurate, and relevant. That means no letup with efforts to ensure data pipelines are flowing unimpeded. With so much at stake, we canvassed industry leaders and experts on what challenges lie ahead and how to address them. Here are some leading issues:

Posted December 18, 2023

The use of real-time data has become common in industries such as finance, retail, and healthcare. This has optimized everything from fraud detection to personalized online shopping, even ensuring that hospitals are staffed with appropriately skilled workers and supplies at the right time. Not only is the use of the technology spreading across industries and companies of all sizes and types, it's evolving to integrate streaming event-based data with historical data to provide contextualized (and more intelligent) insight for actions.

Posted December 13, 2023

The cloud offers a variety of advantages, including scalability, flexibility, cost effectiveness, and security. But today's enterprise cloud initiatives have become more strategic in nature, requiring the public cloud to become its new "hub of innovation."

Posted December 12, 2023

IONIX is extending its industry-leading Attack Surface Management (ASM) platform with Threat Exposure Radar, a threat exposure management capability fully integrated with an attack surface management solution. According to the company, the product innovation provides a unified view of critical exposures from the entire, expanding, enterprise attack surface across cloud, on-premises, SaaS, and third-party systems.

Posted November 16, 2023

My first encounter with enterprise integration dates back to the early 2000s. Remember those days when Enterprise Service Buses (ESB) emerged as the antidote to the convoluted labyrinth of closely interconnected applications? It was the era when architects sought structured approaches to transform the tangled web of point-to-point links into a more coherent system—akin to shifting from spaghetti to lasagna, if you will. This marked the early definition of enterprise integration.

Posted November 16, 2023

Data mesh is still in its infancy, and data personas and organizations are craving clarity and specificity. It is critical to be aware of the "why" and "what" and fully understand the role that knowledge graphs play when considering adopting a data mesh strategy.

Posted November 16, 2023

Velotix, a data security company, announced that Velotix AI-powered data access and policy management is available in the Microsoft Azure marketplace, enabling Microsoft Azure customers to access data while benefiting from scalable, reliable, and serverless analytics.

Posted November 15, 2023

Hitachi Vantara, the modern infrastructure, data management, and digital solutions subsidiary of Hitachi, Ltd., is transforming its existing data storage portfolio to address critical challenges facing IT leaders with the introduction of Hitachi Virtual Storage Platform One a single hybrid cloud data platform.

Posted October 19, 2023

If you wait long enough, everything comes back into style. This timeless principle not only applies to fashion, but also to software development. The technology preferences in the industry have been swinging between bespoke solutions and platform-based solutions due to emerging technologies and their challenges. As someone who has been in the industry since the 1990s, I've witnessed these shifts firsthand.

Posted October 19, 2023

Recently, companies such as Dropbox, Amazon, Lyft, and Meta, as well as Apple, have used the draconian and cruel layoff approach to economic optimization. Yet while the "R" word is bantered around, the "mainstream media" continues to claim that a recession has not yet arrived. This is despite the academic definition of "recession," that is, consecutive quarters of negative gross domestic product growth, as was the case in the first half of 2022.

Posted October 19, 2023

Market research, strategic planning, research and development (R&D), and proactively researching and strategizing for the future are commonplace components of business operations. The exception is the case of governance teams who are far too often recipients of, rather than participants in, strategic planning. As a result, existing policies and practices quickly stagnate or deviate from current usage.

Posted October 10, 2023

The "big data" world is pervasive—to the point in which every organization is now a big data organization. As AI, machine learning, and other high-end analytics become mainstream parts of business operations, new ways of handling data assets are coming to the fore. Industry leaders and experts recently shared their views with Big Data Quarterly on the latest technology developments shaping today's big data world.

Posted October 10, 2023

iboss, a leading name in Zero Trust, is releasing its latest groundbreaking capability, the Azure Cloud Security Gateways, providing security directly within Azure to transform how businesses manage and safeguard their digital ecosystems. According to the company, the Azure Cloud Security Gateways by iboss provide instant security within Azure and its private Virtual Networks.

Posted September 21, 2023

Telmai, the AI-driven data observability platform built for open architecture, is launching its latest release featuring seven category-defining features designed to simplify and accelerate data observability adoption. According to the company, Telmai's release empowers data engineers/architects and product owners to harness powerful time travel features, build multi-attribute data contracts, conduct in-depth root cause analysis of data failures, and gain greater control over data privacy and residency via its new private cloud offerings.

Posted September 20, 2023

The boom in generative AI interest serves as a visible tipping point in the yearslong journey of the enterprise embracing the power of data interaction through natural language processing (NLP). In recent years, NLP has undergone significant changes that have made it increasingly easier for users at all skill levels to handle and explore data without being a data scientist.

Posted September 20, 2023

My fascination with AI began in 2009, when the tech­nology was yet to gain mainstream traction. Today, the recent ChatGPT boom has made AI a normal topic of conversation, and there is no denying that it has become an integral part of our daily lives. From person­alized social media recommendations to autonomous vehicles, many more people are aware of AI's potential to enhance our quality of life.

Posted September 14, 2023

As the world slowly transitions to a post-covid landscape, organizations are looking at what the "new normal" is shaping up to be. To support organizations in navigating through new challenges and a rapidly evolving big data ecosystem, Big Data Quarterly presents 2023's "Big Data 75," a list of companies driving innovation and expanding what is possible in terms of collecting, storing, and extracting value from data.

Posted September 13, 2023

XponentL Data (XponentL), a leading data products solution provider, and Tamr, Inc. (Tamr), a cloud-native data mastering solution, are partnering to deliver cutting-edge data product solutions. According to the companies, this collaboration brings together two industry-leading companies with a shared vision of empowering clients to unlock the full potential of their data.

Posted August 17, 2023

Redis, Inc. is introducing the unified release of Redis 7.2 across the company's complete portfolio, including open source, source-available, commercial cloud, software, and Kubernetes distributions. Redis Enterprise 7.2 cloud and software products preview a scalable search feature which delivers greater performance for query and search use cases, including vector similarity search (VSS).

Posted August 16, 2023

Code42 Software, Inc., the Insider Risk Management (IRM) leader, is partnering with Tines—the no-code automation platform for security teams—to release Incydr Flows, powered by Tines to enable security teams to simplify manual, error-prone, and cross-functional workflows.

Posted August 15, 2023

PEAK:AIO, a provider of a transformative software defined storage platform, is partnering with Stormgrid, a provider of cutting-edge hybrid artificial intelligence (AI) solutions, offering state-of-the-art AI infrastructure to enhance performance and scalability for Stormgrid's burgeoning customer base.

Posted August 14, 2023, a leading AI-powered DevSecOps platform, is adding AI capabilities across its solutions that provide customers with enhanced software delivery capabilities and insights for better decision making.'s AI-Powered DevSecOps Platform reflects enterprise demand to use AI to improve decision making, help govern and orchestrate the release of software created and optimized by generative AI tools, and automate software delivery workflows further with AI, according to the company.

Posted July 19, 2023

Qlik is expanding its platform to deliver a comprehensive best-in-class approach to accessing, transforming, and delivering trusted quality data for analysis and action into Snowflake's Data Cloud. The announcement was made at Snowflake's annual user conference, Snowflake Summit 2023.

Posted July 11, 2023

Matillion, a provider of data productivity solutions, is offering a Productivity Platform for Data Teams, empowering the entire data team to move, transform, and orchestrate data pipelines, regardless of technical capability. The announcement was made at Snowflake's annual user conference, Snowflake Summit 2023.

Posted July 10, 2023

Ah, those comprehensive, yet amazingly unclear terms and conditions (T&C). You know the ones. They include a minimum of 10 pages of scrolling text detailing the company's rights and obligations. Of course, the critical bits regarding your data or rights are beyond the point at which even young eyes go blurry.

Posted June 19, 2023

In April, I was at Hannover Messe, one of the world's largest trade fairs for industrial technology, which is held annually in Hannover, Germany. Due to COVID-19, the event was canceled for a few years, but this year, it was back, and, I'm happy to report, nearly at full scale. I had forgotten how massive it is. The sheer size of the event, with thousands of exhibitors and hundreds of thousands of visitors from all over the world attending each year, was truly mind-blowing. You need to have been there to understand.

Posted June 16, 2023

On April 20, 2009, Oracle announced that it had entered into an agreement to acquire Sun Microsystems. With the purchase of Sun, Oracle entered the hardware business and obtained the Java programming language. It took a decade for Oracle to realize the monetizing potential of Java.

Posted June 15, 2023

The technology pendulum has long been swinging between centralization versus decentralization. Is it better to have a mainframe or distributed systems and data across Windows, Linux, and Unix platforms? Is it better to have these server farms or consolidate things with a cloud provider? Now, the action is moving away from the cloud, toward edge and Internet of Things (IoT) configurations. The enterprise market for edge computing will grow by 22% over the coming year, mainly for hardware, according to estimates from Deloitte Global. By contrast, enterprise networking equipment expenditures will grow by 4%, while overall enterprise IT spending is projected to rise by 6%.

Posted June 14, 2023

Often, enterprise data management falls into two strategies: offensive and defensive. While defense entails mitigating risk, being offensive unlocks new opportunities. Organizations must incorporate both sides to remain competitive. To achieve this, companies can embrace data-centric architectures.

Posted June 13, 2023

Artificial intelligence (AI) is the most discussed hot topic of the moment, but the true impact on our society and the potential impact for enterprises are still unknown. While we may not fully understand its potential impact quite yet, we do understand how AI functions as well as the base level of what it could be capable of. We're already seeing how AI, along with other forms of machine learning (ML) or deep learning, has the potential to revolutionize how organizations function across all industries by doing seemingly small things such as automating repetitive tasks and accelerating outcomes. Those seemingly small things add up and create a big impact.

Posted June 12, 2023

Democratizing data use within an organization empowers employees, fosters greater collaboration, and enables them to make more informed, data-driven decisions. By giving data and analytics tools and solutions to the many, companies can take accurate and timely decision making out of the hands of the few, resulting in improved productivity, increased efficiency, and enhanced business outcomes.

Posted May 18, 2023

Timescale, the cloud data platform company, is making a strategic move to reposition itself in the market, reflecting a significant transformation taking place within the organization that includes a refreshed visual identity, an updated website, and product restructuring.

Posted May 18, 2023

ServiceNow and NVIDIA are collaborating to develop powerful, enterprise-grade generative AI capabilities that can transform business processes with faster, more intelligent workflow automation. According to the company, using NVIDIA software, services, and accelerated infrastructure, ServiceNow is developing custom large language models trained on data specifically for its ServiceNow Platform, the intelligent platform for end-to-end digital transformation.

Posted May 17, 2023

The Zero Trust model has emerged as a game-changing approach to data backup and security. With the proliferation of cyberattacks in recent years, traditional security measures are no longer sufficient. In 2023 alone, it is projected that cybercrime will cost businesses around the world over $8 trillion. This staggering figure underscores the urgent need for companies to adopt a more comprehensive approach to data protection.

Posted May 17, 2023

Veza announced that its Veza Authorization Platform is now available on the Snowflake Data Cloud, enabling joint customers to manage access permissions and secure their sensitive data at scale. By leveraging the Snowflake Data Cloud, Veza is joining Snowflake in mobilizing the world's data to help organizations secure access to sensitive data and achieve continuous compliance, according to the vendor.

Posted May 16, 2023

Low-code and no-code development has become a critical component of enterprise technology landscapes. Gartner predicts that within the next 3 years, developers outside IT departments will account for at least 80% of the userbase for low-code development tools, up from 60% in 2021. Low- and no-code offers opportunities to offload coding and integration work to business users, relieving burdened IT departments.

Posted April 20, 2023

Do you think of your IoT projects in maturity curves? If yes, I applaud you for it. Thinking in maturity curves helps organizations to reduce complexity and to navigate through the unknown. It is a natural behavior and a sound strategy; it is the answer to how to eat an elephant.

Posted April 19, 2023

I'm going to question this Beatlemania-like hysteria that recently hovered over Taylor Swift concert tickets as if Paul McCartney himself hadn't recently delivered, most likely, his last concert in North America. If I were cynical (LOL), I would ask how many bots it would take to create demand which exceeds a sufficient mathematical panic threshold so that actual fans would become so emotionally distraught that they would effectively pay any amount to acquire tickets. How does a monopoly music concert delivery system realize exponentially higher prices than conceivable, weeks before? What exactly does this witchcraft of "dynamic pricing" do? I need to go no further than to examine a similar situation myself. Self-reflection is a wonderful exercise of discovery.

Posted April 19, 2023

The volume of visual data in the world is simply exploding. Consider these facts: Over 1 billion surveillance cameras are estimated to have been installed worldwide. The global self-driving cars market, which uses AI and integrated cameras to perform driving tasks, is projected to grow from over 20 million units in 2021 to more than compound annual growth rate (CAGR) 62 million units by 2030, at a CAGR of 13.3%. Even the average person is estimated to create 1.7 MB of data per second.

Posted April 18, 2023

The world is becoming increasingly digital every day and, as a result, even more data-driven. The datasphere is experiencing stunning growth, with 90% of all data being created over just the past two years. This explosive growth is something that will only continue in the future, and it's clear that as companies begin to amass more and more data, they need to take a hard look at their data management practices.

Posted March 16, 2023

Census, provider of the Data Activation platform that syncs customer data from data warehouses to key business tools, announced a new integration and partnership with Datadog, the monitoring and security platform for cloud applications. By adding Datadog monitoring, Census customers can track the health of real-time reverse ETL syncs using custom alerts and dashboards, according to the vendor.

Posted March 16, 2023



Subscribe to Big Data Quarterly E-Edition