Data Warehousing

Hardware and software that support the efficient consolidation of data from multiple sources in a Data Warehouse for Reporting and Analytics include ETL (Extract, Transform, Load), EAI (Enterprise Application Integration), CDC (Change Data Capture), Data Replication, Data Deduplication, Compression, Big Data technologies such as Hadoop and MapReduce, and Data Warehouse Appliances.

Data Warehousing Articles

Starburst, the open data lakehouse company, is introducing its fully managed Icehouse implementation on Starburst's multi-cloud data lakehouse service, Galaxy. According to the company, with the Galaxy Icehouse, customers can benefit from the scalability, performance, and cost-effectiveness of a combined Trino and Iceberg architecture (Icehouse) without the burden and cost of building and maintaining a custom solution themselves.

Posted April 15, 2024

David Loshin, principal consultant at Knowledge Integrity and James Goodfellow, director of product marketing at Progress joined DBTA's webinar, 6 Challenges of Managing Information in a Modernized Hybrid Data Architecture to explore several major roadblocks that enterprises should consider when adapting to a hybrid data landscape and architecture.

Posted April 12, 2024

Earlier this year, I had the privilege of serving on the organizing committee for the DataTune conference in my hometown of Nashville, Tenn. Unlike many database-specific or platform-specific conferences, which tend to focus on analytics and data science, DataTune covers a wide variety of topics such as database engineering, development, admin­istration, and analytics. I was delighted to be joined on the committee by two friends, Dustin Dorsey and Cameron Cyr, authors of Unlocking dbt: Design and Deploy Transfor­mations in Your Cloud Data Warehouse.

Posted April 11, 2024

Data insights have never been more vital to business operations than they are today. Line-of-business (LOB) teams rely on data insights to drive sustainable growth, lead business operations, and understand cus­tomer behaviors and needs. The growing demand for data analytics has spurred a flourishing $31 billion-plus industry of established and emerging tech companies—but is the data analytics tech stack working for enterprises? Despite years of investment and effort, research indicates that 95% of businesses still strug­gle with operational challenges around data and analytics, leaving only 5% with the competitive advantage data-driven decision making delivers.

Posted April 11, 2024

Data management needs AI and machine learning (ML), and, just as important, AI/ML needs data management. As of now, the two are connected, with the path to suc­cessful AI "intrinsically linked to modern data manage­ment practices," said Dan Soceanu, senior product manager for AI and data management at SAS. Blazing this path requires "pri­oritizing data quality, accessibility, and governance."

Posted April 11, 2024

There is an old quote attributed to various origins that says, "When I hear the word ‘culture,' I reach for my gun." The saying expresses frustration at a term, in this case "culture" being used, abused, and politicized beyond all forbearance. Even when it was first popularized, it was a line meant to draw laughter from the audience of a play, rather than suggesting anyone carry an actual firearm. And no one is suggesting anyone do so now. "Relational" is a term that, over the last few decades, has undergone its own level of use, abuse, and politicization.

Posted April 11, 2024

Gathid is debuting its new approach to identity and access governance, inspired by the power of gathered identities, the platform pinpoints identity and access anomalies with its patented directed graph model. Designed for rapid deployment, immediate applicability, and smooth integration across complex IT infrastructures, this solution tackles the critical need for scalable and cost-effective identity management, according to the company.   

Posted April 10, 2024

AI—both operational and generative—is knocking on enterprises' doors, forcing data managers to make new architectural choices on what it will take to support these data-hungry initiatives. Data mesh and data fabric are increasingly favored to help organizations get better control of their data, but which is the best option?

Posted April 10, 2024

The market is saturated with thousands of purpose-built database systems. This creates too much noise for analysts and scientists dealing with vital data problems across numerous important application domains: genomics, geospatial, and more. To solve this problem, Stavros Papadopoulos, founder and CEO at TileDB, Inc., is introducing the concept of a universal database, which had heretofore been a missed opportunity in the database community.

Posted April 08, 2024

Cisco and a group of eight leading companies including Accenture, Eightfold, Google, IBM, Indeed, Intel, Microsoft, and SAP, as well as six advisors are launching the AI-Enabled Information and Communication Technology (ICT) Workforce Consortium—focused on upskilling and reskilling roles most likely to be impacted by AI.

Posted April 08, 2024

Anais Dotis-Georgiou, lead developer advocate at InfluxData, joined DBTA's webinar, Infrastructure Monitoring Basics with Telegraf, Grafana, and InfluxDB, to provide a comprehensive understanding of infrastructure monitoring, as well as how Telegraf, InfluxDB, and Grafana can be used in tandem to meet modern monitoring needs.

Posted April 03, 2024

As disheartening as it may sound to new graduates, even when you leave school never to return, you still must continue to learn. There are always new tasks to comprehend, and new tools to drive. And when one serves as a data modeler, one is always going to be exposed to new data. Fortunately, if one has a good foundation, acquainting with new data can be easily managed. Every new conceptual or logical data model is an opportunity to develop a deeper understanding about another subject area within an organization.

Posted April 03, 2024

Dremio, the unified lakehouse platform for self-service analytics, announced the general availability of Dremio Cloud on Microsoft Azure, bringing users closer to their data with lakehouse flexibility, scalability, and performance. Dremio Cloud's intuitive unified analytics, high-performance SQL query engine, and lakehouse management service for next-gen DataOps let organizations shift left for a faster time to insight, according to the company.

Posted April 02, 2024

Astronomer, a leader in modern data orchestration, is releasing the latest version of the Astro platform with new features designed to allow users to accelerate innovation while achieving the highest levels of governance and compliance.

Posted April 01, 2024

Matan Libis, VP of product at SQream, Ashwin Rajeeva, co-founder and CTO at Acceldata, and Preeti Kodikal, director of product marketing at Acceldata, joined DBTA's webinar, Building a Next-Generation Data Architecture: Key Capabilities and Strategies, to examine the ways that designing, implementing, integrating, and managing the systems that collect, store, process, and analyze data will successfully support the latest technologies that aim to bring your business to the next level.

Posted March 29, 2024

Observe, Inc., the SaaS observability company reinventing the way machine-generated data is stored, managed, and analyzed, is announcing the completion of its Series B funding round, having raised a total of $115 million.

Posted March 28, 2024

The 11th annual Data Summit conference will be held May 8-9, 2024, at the Hyatt Regency Boston, with pre-conference workshops taking place on May 7, 2024. Early bird pricing is available now until April 5. At Data Summit 2024, you'll hear the innovative approaches the world's leading companies are taking to solve today's key challenges in data management. Whether your interests lie in the technical possibilities and challenges of new and emerging technologies or using Big Data for business intelligence, analytics, and other business strategies, Data Summit 2024 has something for you!

Posted March 28, 2024

DBOS, Inc., the developer of a prominent cloud-native operating system, is debuting its first product offering on the heels of its seed funding results led by Engine Ventures and Construct Capital, with participation from Sinewave and GutBrain Ventures. Backed by $8.5 million in funding, DBOS is releasing DBOS Cloud, a solution born from the idea of building database-oriented infrastructure in the cloud.

Posted March 28, 2024

Database administration is a very technical discipline, but it is also a discipline in which the practitioner is very visible politically within the organization. DBAs should be armed with a proper attitude and sufficient technical knowledge before attempting to practice database administration. This column usually covers the many diverse technology issues with which DBAs must deal. But for this month, we are going to take a short diversion and discuss some high-level guidance for DBAs to follow that can make their job easier to deal with.

Posted March 27, 2024

Kyndryl, an IT infrastructure services provider, and Cloudflare, Inc., a leading connectivity cloud company, are extending their partnership, forming the Global Strategic Alliance to enable enterprises to migrate and manage networks for multi-cloud connectivity and comprehensive network security.

Posted March 25, 2024

One configures SQL Server for high availability (HA) in anticipation of some event that will cause a critical application to go offline unexpectedly—a software glitch that causes an app to freeze or a fault in storage that brings down a disk, for example. A well-designed HA solution will cause a secondary instance of your application and database infrastructure—running in a nearby but geographically distinct data center—to assume your critical loads and keep your operations running smoothly, with no loss of data.

Posted March 20, 2024

Alkira, a provider of agentless multi-cloud networking, and RestorePoint.AI, the Secure Managed Data as a Service company, are partnering to deliver cloud-based data management services running on a private secure network. The announcement was made at the Gartner Data & Analytics Summit in Orlando, FL.

Posted March 13, 2024

Selector AI, the provider of network-aware AIOps, observability, and multi-domain analytics, is debuting its Spring 2024 release, introducing a variety of innovative technologies designed to enable enterprises to truly understand and take action on their telemetry from a single, streamlined pane of glass, according to the company.

Posted March 13, 2024

The remarkable and rapid uptake of ChatGPT and similar large language model (LLM)-based AIs may be driving the biggest increase in demand for computing power since the advent of the internet. The neural networks that power LLM AI solutions, such as ChatGPT, rely on massively parallel processing. This processing is similar in some respects to the massively parallel graphics processing that was demanded in the past by computer games.

Posted March 13, 2024

Janis Griffin, senior technical consultant at Quest Software, and Paul Lewis, chief technology officer at Pythian, joined DBTA's webinar The Role of the DBA in 2024: Changes, Challenges, and Opportunities, to identify the ways in which IT decision makers and database professionals can meet the demands of their adaptive ecosystems with ease.

Posted March 12, 2024

Cloudera, the data company for trusted enterprise AI, is introducing the next phase of its open data lakehouse on private cloud, making enhancements that revolutionize on-premises data experiences for trusted analytics and AI at scale. By delivering Apache Iceberg for private clouds, Cloudera is empowering every organization to overcome these issues and quickly scale enterprise AI deployments to generate greater value, according to the company.

Posted March 11, 2024

ServiceNow, Hugging Face, and NVIDIA are releasing StarCoder2, a family of open-access large language models for code generation, aiming to set new standards for performance, transparency, and cost-effectiveness. StarCoder2 was developed in partnership with the BigCode Community, managed by ServiceNow and Hugging Face, where the machine learning community collaborates on models, datasets, and applications, according to the vendors.

Posted March 11, 2024

Alation, Inc., the data intelligence company, is offering the major release of the Alation Data Intelligence Platform, introducing a next-generation user interface and business lineage capabilities built for data and analytics teams. Additionally, a new Alation Expert Services offering empowers both business and data leaders to measure and strengthen their organization's data culture with an emphasis on four foundational pillars: data search and discovery, data governance, data literacy, and data leadership. 

Posted March 11, 2024

In far too many organizations, processes become automatic. Requests are made, and requests are fulfilled. People wish to please; they like to show how fast they can respond or how agile they are. The same is true when addressing database design. This delivery-focused desire comes from a good place. However, regardless of how well-intended, blindly fulfilling requests is dangerous and harmful to one's overall results. Optimization of processes, especially processes involving database design, should never remove the step where questions are asked and rationale is provided.

Posted March 11, 2024

SecurityPal, a leader in customer assurance technology, unveiled the creation of the SecurityPal Council, an initiative bringing together top thought leaders and industry experts in cybersecurity to foster collaboration, share insights, and shape the future of cybersecurity in an ever-evolving digital landscape. The SecurityPal Council consists of select members who have demonstrated exceptional leadership and expertise in the cybersecurity field, and includes leaders from some of the world's most innovative companies like OpenAI, MongoDB, Perforce, Snap, and Orum, among others.

Posted March 08, 2024

Pure Storage, the IT pioneer that delivers the world's most advanced data storage technologies and services, is debuting new self-service capabilities that propel the company on its strategic shift towards delivering modern, autonomous Storage-as-a-Service (StaaS) and SaaS experiences.

Posted March 07, 2024

Alation, Inc., the data intelligence company, is offering new integrations with leading technical partners to further increase the breadth and depth of the Alation Data Intelligence Platform. The new integrations with Amazon DynamoDB, Apache Kafka, Confluent Kafka, Elasticsearch, Fivetran, MongoDB, TIBCO Data Virtualization, and TIBCO Spotfire build on the open and extensible Alation Open Connector Framework, integrating with a global network of over 100 enterprise connectors, allowing organizations to access trusted data across their data ecosystem, according to Alation.

Posted March 06, 2024

Qumulo, the simple way to manage exabyte-scale data anywhere, is debuting Azure Native Qumulo Cold (ANQ Cold), a cloud-native service for managing and storing "cold" file data at any scale with cost effectiveness at the forefront.

Posted March 05, 2024

Dell Technologies and CrowdStrike are expanding their partnership to deliver Dell's Managed Detection and Response (MDR) services with the AI-native CrowdStrike Falcon XDR platform, helping customers defend against increasingly complex cyberattacks. 

Posted March 05, 2024

NetApp, the intelligent data infrastructure company, is announcing a myriad of new capabilities, spanning both cyber-resiliency and generative AI (GenAI) implementation with NVIDIA. With these latest features, NetApp upholds a commitment to holistically protecting data as well as maximizing its value in the realm of GenAI.

Posted March 05, 2024

The nominations period for the 2024 DBTA Readers' Choice Awards is now extended through March 15, 2024 - followed by actual voting on the products nominated by our readers. Votes can only be cast for nominated products, so be sure to make your nominations now!

Posted March 05, 2024, the Data Products company, is releasing its Professional Edition of the Data Products Platform in response to a critical market demand: a fully managed and supported SaaS platform for dbt Core users on the Snowflake Data Cloud.  

Posted March 04, 2024

Seeq, a provider of industrial analytics and AI solutions, is debuting the Seeq AI Assistant, a generative AI (GenAI) resource embedded across its industrial analytics platform that provides real-time assistance to users across the enterprise. The Seeq AI Assistant empowers users to accelerate mastery of the Seeq platform, build advanced analytics, machine learning, and AI skills and knowledge, and accelerate insights to improve decision making in pursuit of operational excellence and sustainability, according to the company.

Posted March 01, 2024

OVHcloud US, a leading global cloud provider, is introducing OVHcloud Managed Databases, offering clients a "configure-and-forget" solution to simplify the set-up and management of cloud databases. With OVHcloud US Managed Database services, the solution takes care of the database infrastructure and administration, including set-up, backup, scalability, and security.

Posted February 29, 2024

Flexera announced that it has completed the acquisition of Snow Software, giving customers the ability to derive more value from their technology investments with unprecedented visibility into their hybrid IT estate.

Posted February 29, 2024

Synadia Communications, Inc., creator and maintainer of (NATS), announced it has closed a $25 million Series B financing round, further validating the company's holistic approach to solving the increasingly complex and pervasive challenges of distributed computing, which is driving rapid growth in edge computing investments.

Posted February 29, 2024

Prosimo, a provider of multi-cloud networking software, is releasing an AI Suite for Multi-Cloud Networking, empowering teams to bring AI workloads to market faster and supercharging AI readiness. Prosimo AI Suite for Multi-Cloud Networking is a full-stack, cloud-native platform that understands connectivity needs across L3 to L7 and enables enterprises to take advantage of cloud-native connectivity designed for AI, according to the company.

Posted February 29, 2024

Semgrep, a code security solution designed for engineering-centric security programs, announced general availability and support for C and C++ programming languages in Semgrep Code, aiming to set a new standard for rapidly securing C and C++ codebases without compromising on accuracy or efficiency. Semgrep Code is a fast, customizable, and developer-oriented static application security testing (SAST) solution.

Posted February 28, 2024