Data Warehousing

Hardware and software that support the efficient consolidation of data from multiple sources in a Data Warehouse for Reporting and Analytics include ETL (Extract, Transform, Load), EAI (Enterprise Application Integration), CDC (Change Data Capture), Data Replication, Data Deduplication, Compression, Big Data technologies such as Hadoop and MapReduce, and Data Warehouse Appliances.

Data Warehousing Articles

In 2023, the integration of generative AI (GenAI) into the constantly evolving landscape of data management emerged as a game changer, promising to reshape the way organizations interact with databases, data, and metadata. In 2024, as enterprises hamstrung by hiring and budget woes continue to be judged by their productivity and efficiency, they'll also be judged by their ability to do two things: deliver actionable insights and provide guidance in an easily consumable format and empower users of all skill levels to interact with key data and drive insights.

Posted April 17, 2024

BMC, a global leader in software solutions for the Autonomous Digital Enterprise, is acquiring the Netreo, a provider of smart and secure IT network and application observability solutions enabling the BMC Helix platform to provide customers with a full-stack, open observability, and AIOps solution. With this acquisition, BMC continues to invest in innovation—from IT operations management to service management, data and application workflow automation, and mainframe management, according to the company. 

Posted April 17, 2024

Innovation in the big data and analytics space continues to blossom, with more companies than ever before riding the high of generative AI. Along with the myriad possibilities of this new sphere of artificial intelligence comes some questions and concerns. Startups are emerging to address challenges and leverage opportunities this new area may bring. Here are 30 startups DBTA thinks are worth watching in 2024.

Posted April 17, 2024

Oracle NetSuite is introducing a series of new product innovations to help businesses in the U.K. optimize finance processes, expand insights, and increase efficiency. The latest updates for customers in the U.K. include new generative AI, enterprise performance management (EPM) and e-invoicing capabilities, and the ability to combine insights from multiple NetSuite instances into a single NetSuite Analytics Warehouse environment.

Posted April 17, 2024

There is much ado these days regarding the language facility popular AI tools such as ChatGPT, Midjourney, Microsoft Copilot, and Gemini Connected appear to display. What do these systems comprehend? Do they understand? Are the underlying architectures a big leap toward artificial general intelligence (AGI) or an entertaining dead end? This article is not about that. This is a loosely related thread on how the language we use to describe AI systems affects our ability to govern them effectively.

Posted April 16, 2024

Qumulo, the simple way to manage exabyte-scale data anywhere, is debuting the private availability of the Qumulo Cloud Native file system, an enterprise-proven, multi-protocol file system to store, manage, and curate unstructured data at the exabyte scale in conjunction with the power of Amazon S3 buckets and AWS infrastructure.

Posted April 16, 2024

Backblaze, Inc., the specialized cloud storage platform, is unveiling a new function for Backblaze B2 Cloud Storage that instantly alerts users and external cloud services when data within the storage platform changes. This service—dubbed Event Notifications—empowers enterprises to craft their automated cloud workflows without being restricted to a single vendor or legacy tool to provide notification features.

Posted April 15, 2024

Starburst, the open data lakehouse company, is introducing its fully managed Icehouse implementation on Starburst's multi-cloud data lakehouse service, Galaxy. According to the company, with the Galaxy Icehouse, customers can benefit from the scalability, performance, and cost-effectiveness of a combined Trino and Iceberg architecture (Icehouse) without the burden and cost of building and maintaining a custom solution themselves.

Posted April 15, 2024

David Loshin, principal consultant at Knowledge Integrity and James Goodfellow, director of product marketing at Progress joined DBTA's webinar, 6 Challenges of Managing Information in a Modernized Hybrid Data Architecture to explore several major roadblocks that enterprises should consider when adapting to a hybrid data landscape and architecture.

Posted April 12, 2024

There is an old quote attributed to various origins that says, "When I hear the word ‘culture,' I reach for my gun." The saying expresses frustration at a term, in this case "culture" being used, abused, and politicized beyond all forbearance. Even when it was first popularized, it was a line meant to draw laughter from the audience of a play, rather than suggesting anyone carry an actual firearm. And no one is suggesting anyone do so now. "Relational" is a term that, over the last few decades, has undergone its own level of use, abuse, and politicization.

Posted April 11, 2024

Gathid is debuting its new approach to identity and access governance, inspired by the power of gathered identities, the platform pinpoints identity and access anomalies with its patented directed graph model. Designed for rapid deployment, immediate applicability, and smooth integration across complex IT infrastructures, this solution tackles the critical need for scalable and cost-effective identity management, according to the company.   

Posted April 10, 2024

AI—both operational and generative—is knocking on enterprises' doors, forcing data managers to make new architectural choices on what it will take to support these data-hungry initiatives. Data mesh and data fabric are increasingly favored to help organizations get better control of their data, but which is the best option?

Posted April 10, 2024

The market is saturated with thousands of purpose-built database systems. This creates too much noise for analysts and scientists dealing with vital data problems across numerous important application domains: genomics, geospatial, and more. To solve this problem, Stavros Papadopoulos, founder and CEO at TileDB, Inc., is introducing the concept of a universal database, which had heretofore been a missed opportunity in the database community.

Posted April 08, 2024

Cisco and a group of eight leading companies including Accenture, Eightfold, Google, IBM, Indeed, Intel, Microsoft, and SAP, as well as six advisors are launching the AI-Enabled Information and Communication Technology (ICT) Workforce Consortium—focused on upskilling and reskilling roles most likely to be impacted by AI.

Posted April 08, 2024

Anais Dotis-Georgiou, lead developer advocate at InfluxData, joined DBTA's webinar, Infrastructure Monitoring Basics with Telegraf, Grafana, and InfluxDB, to provide a comprehensive understanding of infrastructure monitoring, as well as how Telegraf, InfluxDB, and Grafana can be used in tandem to meet modern monitoring needs.

Posted April 03, 2024

As disheartening as it may sound to new graduates, even when you leave school never to return, you still must continue to learn. There are always new tasks to comprehend, and new tools to drive. And when one serves as a data modeler, one is always going to be exposed to new data. Fortunately, if one has a good foundation, acquainting with new data can be easily managed. Every new conceptual or logical data model is an opportunity to develop a deeper understanding about another subject area within an organization.

Posted April 03, 2024

Dremio, the unified lakehouse platform for self-service analytics, announced the general availability of Dremio Cloud on Microsoft Azure, bringing users closer to their data with lakehouse flexibility, scalability, and performance. Dremio Cloud's intuitive unified analytics, high-performance SQL query engine, and lakehouse management service for next-gen DataOps let organizations shift left for a faster time to insight, according to the company.

Posted April 02, 2024

Astronomer, a leader in modern data orchestration, is releasing the latest version of the Astro platform with new features designed to allow users to accelerate innovation while achieving the highest levels of governance and compliance.

Posted April 01, 2024

Matan Libis, VP of product at SQream, Ashwin Rajeeva, co-founder and CTO at Acceldata, and Preeti Kodikal, director of product marketing at Acceldata, joined DBTA's webinar, Building a Next-Generation Data Architecture: Key Capabilities and Strategies, to examine the ways that designing, implementing, integrating, and managing the systems that collect, store, process, and analyze data will successfully support the latest technologies that aim to bring your business to the next level.

Posted March 29, 2024

Observe, Inc., the SaaS observability company reinventing the way machine-generated data is stored, managed, and analyzed, is announcing the completion of its Series B funding round, having raised a total of $115 million.

Posted March 28, 2024

The 11th annual Data Summit conference will be held May 8-9, 2024, at the Hyatt Regency Boston, with pre-conference workshops taking place on May 7, 2024. Early bird pricing is available now until April 5. At Data Summit 2024, you'll hear the innovative approaches the world's leading companies are taking to solve today's key challenges in data management. Whether your interests lie in the technical possibilities and challenges of new and emerging technologies or using Big Data for business intelligence, analytics, and other business strategies, Data Summit 2024 has something for you!

Posted March 28, 2024

DBOS, Inc., the developer of a prominent cloud-native operating system, is debuting its first product offering on the heels of its seed funding results led by Engine Ventures and Construct Capital, with participation from Sinewave and GutBrain Ventures. Backed by $8.5 million in funding, DBOS is releasing DBOS Cloud, a solution born from the idea of building database-oriented infrastructure in the cloud.

Posted March 28, 2024

Database administration is a very technical discipline, but it is also a discipline in which the practitioner is very visible politically within the organization. DBAs should be armed with a proper attitude and sufficient technical knowledge before attempting to practice database administration. This column usually covers the many diverse technology issues with which DBAs must deal. But for this month, we are going to take a short diversion and discuss some high-level guidance for DBAs to follow that can make their job easier to deal with.

Posted March 27, 2024

Kyndryl, an IT infrastructure services provider, and Cloudflare, Inc., a leading connectivity cloud company, are extending their partnership, forming the Global Strategic Alliance to enable enterprises to migrate and manage networks for multi-cloud connectivity and comprehensive network security.

Posted March 25, 2024

One configures SQL Server for high availability (HA) in anticipation of some event that will cause a critical application to go offline unexpectedly—a software glitch that causes an app to freeze or a fault in storage that brings down a disk, for example. A well-designed HA solution will cause a secondary instance of your application and database infrastructure—running in a nearby but geographically distinct data center—to assume your critical loads and keep your operations running smoothly, with no loss of data.

Posted March 20, 2024

Alkira, a provider of agentless multi-cloud networking, and RestorePoint.AI, the Secure Managed Data as a Service company, are partnering to deliver cloud-based data management services running on a private secure network. The announcement was made at the Gartner Data & Analytics Summit in Orlando, FL.

Posted March 13, 2024

Selector AI, the provider of network-aware AIOps, observability, and multi-domain analytics, is debuting its Spring 2024 release, introducing a variety of innovative technologies designed to enable enterprises to truly understand and take action on their telemetry from a single, streamlined pane of glass, according to the company.

Posted March 13, 2024

The remarkable and rapid uptake of ChatGPT and similar large language model (LLM)-based AIs may be driving the biggest increase in demand for computing power since the advent of the internet. The neural networks that power LLM AI solutions, such as ChatGPT, rely on massively parallel processing. This processing is similar in some respects to the massively parallel graphics processing that was demanded in the past by computer games.

Posted March 13, 2024

Janis Griffin, senior technical consultant at Quest Software, and Paul Lewis, chief technology officer at Pythian, joined DBTA's webinar The Role of the DBA in 2024: Changes, Challenges, and Opportunities, to identify the ways in which IT decision makers and database professionals can meet the demands of their adaptive ecosystems with ease.

Posted March 12, 2024

Cloudera, the data company for trusted enterprise AI, is introducing the next phase of its open data lakehouse on private cloud, making enhancements that revolutionize on-premises data experiences for trusted analytics and AI at scale. By delivering Apache Iceberg for private clouds, Cloudera is empowering every organization to overcome these issues and quickly scale enterprise AI deployments to generate greater value, according to the company.

Posted March 11, 2024

ServiceNow, Hugging Face, and NVIDIA are releasing StarCoder2, a family of open-access large language models for code generation, aiming to set new standards for performance, transparency, and cost-effectiveness. StarCoder2 was developed in partnership with the BigCode Community, managed by ServiceNow and Hugging Face, where the machine learning community collaborates on models, datasets, and applications, according to the vendors.

Posted March 11, 2024

Alation, Inc., the data intelligence company, is offering the major release of the Alation Data Intelligence Platform, introducing a next-generation user interface and business lineage capabilities built for data and analytics teams. Additionally, a new Alation Expert Services offering empowers both business and data leaders to measure and strengthen their organization's data culture with an emphasis on four foundational pillars: data search and discovery, data governance, data literacy, and data leadership. 

Posted March 11, 2024

In far too many organizations, processes become automatic. Requests are made, and requests are fulfilled. People wish to please; they like to show how fast they can respond or how agile they are. The same is true when addressing database design. This delivery-focused desire comes from a good place. However, regardless of how well-intended, blindly fulfilling requests is dangerous and harmful to one's overall results. Optimization of processes, especially processes involving database design, should never remove the step where questions are asked and rationale is provided.

Posted March 11, 2024

SecurityPal, a leader in customer assurance technology, unveiled the creation of the SecurityPal Council, an initiative bringing together top thought leaders and industry experts in cybersecurity to foster collaboration, share insights, and shape the future of cybersecurity in an ever-evolving digital landscape. The SecurityPal Council consists of select members who have demonstrated exceptional leadership and expertise in the cybersecurity field, and includes leaders from some of the world's most innovative companies like OpenAI, MongoDB, Perforce, Snap, and Orum, among others.

Posted March 08, 2024

Pure Storage, the IT pioneer that delivers the world's most advanced data storage technologies and services, is debuting new self-service capabilities that propel the company on its strategic shift towards delivering modern, autonomous Storage-as-a-Service (StaaS) and SaaS experiences.

Posted March 07, 2024

Alation, Inc., the data intelligence company, is offering new integrations with leading technical partners to further increase the breadth and depth of the Alation Data Intelligence Platform. The new integrations with Amazon DynamoDB, Apache Kafka, Confluent Kafka, Elasticsearch, Fivetran, MongoDB, TIBCO Data Virtualization, and TIBCO Spotfire build on the open and extensible Alation Open Connector Framework, integrating with a global network of over 100 enterprise connectors, allowing organizations to access trusted data across their data ecosystem, according to Alation.

Posted March 06, 2024

Qumulo, the simple way to manage exabyte-scale data anywhere, is debuting Azure Native Qumulo Cold (ANQ Cold), a cloud-native service for managing and storing "cold" file data at any scale with cost effectiveness at the forefront.

Posted March 05, 2024

Dell Technologies and CrowdStrike are expanding their partnership to deliver Dell's Managed Detection and Response (MDR) services with the AI-native CrowdStrike Falcon XDR platform, helping customers defend against increasingly complex cyberattacks. 

Posted March 05, 2024

NetApp, the intelligent data infrastructure company, is announcing a myriad of new capabilities, spanning both cyber-resiliency and generative AI (GenAI) implementation with NVIDIA. With these latest features, NetApp upholds a commitment to holistically protecting data as well as maximizing its value in the realm of GenAI.

Posted March 05, 2024

The nominations period for the 2024 DBTA Readers' Choice Awards is now extended through March 15, 2024 - followed by actual voting on the products nominated by our readers. Votes can only be cast for nominated products, so be sure to make your nominations now!

Posted March 05, 2024, the Data Products company, is releasing its Professional Edition of the Data Products Platform in response to a critical market demand: a fully managed and supported SaaS platform for dbt Core users on the Snowflake Data Cloud.  

Posted March 04, 2024

Seeq, a provider of industrial analytics and AI solutions, is debuting the Seeq AI Assistant, a generative AI (GenAI) resource embedded across its industrial analytics platform that provides real-time assistance to users across the enterprise. The Seeq AI Assistant empowers users to accelerate mastery of the Seeq platform, build advanced analytics, machine learning, and AI skills and knowledge, and accelerate insights to improve decision making in pursuit of operational excellence and sustainability, according to the company.

Posted March 01, 2024

OVHcloud US, a leading global cloud provider, is introducing OVHcloud Managed Databases, offering clients a "configure-and-forget" solution to simplify the set-up and management of cloud databases. With OVHcloud US Managed Database services, the solution takes care of the database infrastructure and administration, including set-up, backup, scalability, and security.

Posted February 29, 2024