Data Warehousing

Hardware and software that support the efficient consolidation of data from multiple sources in a Data Warehouse for Reporting and Analytics include ETL (Extract, Transform, Load), EAI (Enterprise Application Integration), CDC (Change Data Capture), Data Replication, Data Deduplication, Compression, Big Data technologies such as Hadoop and MapReduce, and Data Warehouse Appliances.

Data Warehousing Articles

Kaladhar Voruganti, senior technologist in office of the chief revenue officer at Equinix, and Rory Kelleher, director of global business development for healthcare at NVIDIA, led Data Summit's session, "Succeeding With AI in the Cloud," to discuss strategies and methods to effectively utilize AI within business operations.

Posted May 11, 2023

At the annual Data Summit's second keynote presentation, speakers Mike Bechtel, chief futurist at Deloitte Consulting LLC, and Ankit Patel, SVP of engineering at Foursquare, explored the possibilities that await any organization seeking to transform their businesses for the better, highlighting trust and geospatial datasets as the key.

Posted May 11, 2023

In 1961, a clever science fiction author named Robert Heinlein coined a new term in one of his novels. The term was "grok." Grok is a wonderful word that means "to empathize or communicate sympathetically; also, to experience enjoyment," and is a term similar to the later sixties phrase "dig it." Grok meanings also include "to drink," "to love," and "to be one with." Grok can apply when one experiences those moments of insight as a new realization coalesces in one's mind, or as that joyful experience continues to provide a thrill. Perhaps grok can be a mental state one achieves as one attains the peacefulness advertised in another 1960s term—"be here now." Grokking can be vital in working through the creation of a new logical data model. If one does not understand the data, then one cannot model the data. Alternately, if one groks the data, the data modeling efforts will flow freely.

Posted May 11, 2023

Inc. magazine revealed that RDM Infinity landed a spot on the third-annual Inc. 5000 Regionals: Rocky Mountain list, a prestigious ranking of private companies based in Colorado, Idaho, Montana, Nevada, Utah, and Wyoming. RDM achieved a median revenue growth of 195% between 2019 and 2021, earning it a coveted place among just 59 other regional businesses recognized for their tremendous growth in a challenging economic climate.

Posted May 11, 2023

While data quality tools find issues in production, it is too little, too late. Production data issues are expensive to fix and cause business discontinuity and reputation risk. iceDQ believes companies should adopt a left-shift approach to prevent faulty processes and data from entering production. Sandesh Gawande, CTO, iCEDQ, discussed "Data Testing: A Left-Shift Approach to Data Quality" during his Data Summit 2023 presentation.

Posted May 10, 2023

It's time to vote for the annual Database Trends and Applications Readers' Choice Awards, a competition in which the winning information management solutions, products, and services are selected by you, the readers. The voting period is now extended through Wednesday, May 17.

Posted May 08, 2023

Honeycomb, an observability platform used by high-performing engineering teams, is launching and fully-executing Natural Language Querying using generative AI for its new capability, Query Assistant. This development dramatically scales the platform's query power and makes observability more usable for all engineering levels, according to the company.

Posted May 04, 2023

The pandemic significantly accelerated the pace of technological advancement and digital transformation, generating a need for new digital programs and solutions. The drive to meet this demand has increased pressure on IT departments, which, in turn, has heightened collaboration between IT and line-of-business (LOB) executives. Business technologists, or staff members who are not in the IT department but leverage technology to solve their business problem to improve the productivity of their department, are increasingly choosing the applications, technology frameworks, and platforms that help them solve their business problems without heavy reliance on IT.

Posted May 03, 2023

Vercel is offering a suite of serverless storage options now available in the Vercel Dashboard, powered by the best infrastructure providers in the industry. Vercel KV, Vercel Postgres, and Vercel Blob are built on open standards and protocols, designed for low latency, efficient data fetching, and fully integrated with the company's existing tools and workflows.

Posted May 02, 2023

MySQL experts joined DBTA's webinar, "Best Practices for Accelerating your MySQL Data," to examine architectural tips and best practices that can best support large-scale MySQL operations while enabling the delivery of highly-performant applications—paying particular attention to replication and data protection at scale, simpler storage management, higher density, and higher availability in virtualized environments.

Posted May 01, 2023

Starburst, the data lake analytics platform, is offering a new integration with dbt Cloud, a fast and reliable way to deploy dbt, enabling dbt users to easily build data pipelines spanning multiple data sources on one central plane. The integration includes an enhanced adapter between dbt Cloud and Starburst's SaaS offering, Starburst Galaxy, enabling dbt users to easily federate data across multiple disparate sources or access new data sources before it lands in their central data lake or warehouse.

Posted April 28, 2023

InfluxData is launching InfluxDB 3.0, to deliver a series of time series capabilities enacted across the company's product portfolio, including its new product, InfluxDB Cloud Dedicated.

Posted April 27, 2023

A new global IBM Institute for Business Value (IBV) study, "The ESG conundrum," of executives and consumers found that while an increased focus on environmental sustainability remains a top priority for consumers and business executives, inadequate data is a key challenge for both groups when it comes to achieving personal and corporate Environmental, Social and Governance (ESG) goals.

Posted April 24, 2023

Aerospike is releasing Aerospike Database 6.3, delivering operational, quality, performance, and stability improvements. Aerospike Database 6.3 adds support for OpenSSL 3, which means that it runs well on Red Hat Enterprise Linux 9 (RHEL) and its many clones, as well as Ubuntu 22.04. The release continues to support RHEL and Debian-compatible Linux distributions that come with OpenSSL 1. One caveat is that support for Debian 10 on ARM64 hardware has been discontinued, however, server 6.3 still runs on Debian 10 on x86_64.

Posted April 19, 2023

The volume of visual data in the world is simply exploding. Consider these facts: Over 1 billion surveillance cameras are estimated to have been installed worldwide. The global self-driving cars market, which uses AI and integrated cameras to perform driving tasks, is projected to grow from over 20 million units in 2021 to more than compound annual growth rate (CAGR) 62 million units by 2030, at a CAGR of 13.3%. Even the average person is estimated to create 1.7 MB of data per second.

Posted April 18, 2023

Dataiku, the platform for Everyday AI, and Genpact, a global professional services firm focused on delivering outcomes that transform businesses, are forming a strategic alliance to help organizations accelerate artificial intelligence (AI) and machine learning (ML) initiatives. Dataiku's Everyday AI platform, combined with Genpact's technology-agnostic MLOps and Responsible AI framework, will provide a differentiated solution that addresses major challenges faced by organizations in the implementation of AI, such as data governance, model management, and compliance requirements, according to the companies.

Posted April 18, 2023

Experts joined DBTA's webinar, "Database Management in the Cloud: Adapting to the Changing Landscape," to explore database strategies and skills that will inevitably bring about successful cloud environments.

Posted April 14, 2023

Just a few years ago, no one would have imagined running their SQL Server databases on anything other than Windows Server. Now, with companies requiring data-driven capabilities for a range of needs, the idea of running SQL Server on a non-Windows platform has become almost commonplace—whether on open-source operating systems or in the cloud.

Posted April 13, 2023

Organizations often force the DBA to take on the job of data modeling. That does not mean that DBAs are well-trained in data modeling, nor does it mean that DBAs are best suited to take on this task. The data administration (DA) team is best suited for modeling data. This is because data modeling requires knowledge of the business aspects of data resource management.

Posted April 13, 2023

Startups continue to emerge this year, addressing challenges and leveraging opportunities in innovative and novel ways. The landscape is constantly changing, and 2023 is no different. These companies bring fresh approaches to accelerating digital transformation, expanding what's possible with AI and analytics, breaking down silos, enhancing security, improving data observability, becoming a part of data fabric or mesh, and more.

Posted April 12, 2023

The 10th annual Data Summit conference will be held May 10-11, 2023, at the Hyatt Regency Boston, with pre-conference workshops taking place on May 9, 2023. Whether your interests lie in the technical possibilities and challenges of new and emerging technologies or using Big Data for business intelligence, analytics, and other business strategies, Data Summit 2023 has something for everyone.

Posted April 11, 2023

Kyligence is announcing the general availability of Kyligence Zen, a low-code, centralized metrics platform to define, collect, and analyze enterprise-grade metrics.

Posted April 11, 2023

Alation Inc., a provider of enterprise data intelligence solutions, is expanding partnerships with Databricks, the lakehouse company, and dbt Labs, a provider of analytics engineering, to extend knowledge, collaboration, and trust across the modern data stack. Joint customers can now easily integrate rich metadata from Databricks Unity Catalog and leverage a new connector that provides support for dbt Core and dbt Cloud in Alation. As a result, users have a better understanding of their data landscape and can view underlying data changes and transformations to power data intelligence, according to Alation.

Posted April 11, 2023

Fivetran, a global leader in automated data movement, is introducing support for Amazon Simple Storage Service (Amazon S3) with Apache Iceberg data lake format to combine large-volume, cost-effective data storage with simple access and comprehensive compliance.

Posted April 11, 2023

Honeycomb, a leading observability platform used by high-performing engineering teams, announced it has raised $50 million in Series D funding, propelling the company's expansion globally and support for OpenTelemetry, along with efforts toward building a cohesive integration strategy across the entire software development ecosystem.

Posted April 06, 2023

Snyk, a leader in developer security, is releasing SnykLaunch April 2023, a series of strategic enhancements to the company's Developer Security Platform to enable global enterprises to create a secure software supply chain, while advancing greater DevSecOps collaboration and enhancing developer productivity.

Posted April 05, 2023

Databricks is announcing the Databricks Lakehouse for Manufacturing, the first open, enterprise scale lakehouse platform—designed with the manufacturer in mind—to lower costs, boost productivity, and unify data ecosystems, as well as AI.

Posted April 05, 2023

CloudBees, a software delivery platform for enterprises, announced the integration of CloudBees' continuous delivery and release orchestration solution, CloudBees CD/RO, with Argo Rollouts to enhance customers' ability to deliver software faster, with higher quality, and at scale in cloud-native environments.

Posted April 04, 2023

Dremio, an open and easy data lakehouse company, and Domo, a data experience platform innovator, are forming a new partnership to expand access to critical data for better decision-making with native data integration with Domo Cloud Amplifier, allowing joint customers to easily connect to Domo to analyze data directly on the data lakehouse.

Posted April 04, 2023

Experts joined DBTA's webinar, "From Edge to Cloud: IoT Data Management and Stream Processing," to explore how new approaches to data management can mean the difference between relying on archaic infrastructures and adopting agile, flexible, and scalable data processes.

Posted April 03, 2023

Domo is launching several new features to enhance the data experience for everyone across an organization, regardless of their skill level, reaching people at all stages of their data journey. "Our focus is to make data accessible and actionable through human-first data experiences. We want to enable everyone with the ability to leverage data, no matter their role or comfort level working with data," said Ben Schein, SVP of product at Domo.

Posted March 31, 2023

Incorta, the real-time business analytics company, is partnering with Google Cloud as part of several initiatives surrounding cloud computing and analytics deployments. The collaboration is aimed at helping companies move their business application and enterprise resource planning data into the cloud.

Posted March 30, 2023

Logpoint is introducing new capabilities to its cybersecurity operations platform, converging SIEM, SOAR, UEBA, endpoint security, and Business-Critical Security (BCS) technologies. The new capabilities enable security analysts to protect the organization against threats by increasing observability and decreasing the time to respond to threats.

Posted March 30, 2023

It's time to vote for the annual Database Trends and Applications Readers' Choice Awards, a competition in which the winning information management solutions, products, and services are selected by you, the readers. The voting period will be open through Wednesday, May 10.

Posted March 29, 2023

Jitterbit, a global provider for empowering transformation through automation, is acquiring Zudy, a leading no-code/low-code application development platform provider for enterprise organizations. This acquisition expands on Jitterbit's existing capabilities in the no-code/low-code application development space, further demonstrating the company's commitment to providing a best-in-class suite of tools and services for integrating and automating business processes, according to the company.

Posted March 27, 2023

Semarchy, a master data management and data integration leader, is introducing new capabilities to enable organizations to capitalize on their data that include integration with Microsoft Azure, new visibility and control for MDM workflows, and simplified data integration infrastructure deployment through Docker images.

Posted March 27, 2023

DuploCloud is announcing the general availability of its on-prem solution that improves Kubernetes implementation for mid-market and enterprise organizations.

Posted March 22, 2023

Snow Software, a global leader in technology intelligence, is releasing Snow SaaS Management, a new version of its software-as-a-service (SaaS) management solution that supports IT leaders' need to take control of their sprawl, manage surprise SaaS costs, mitigate compliance and security risks, and optimize overall spend.

Posted March 22, 2023

Zebra Technologies Corporation, an innovator at the front line of business with solutions and partners that deliver a performance edge, is releasing Zebra Picking Plus, an Application Programming Interface (API) for SAP Extended Warehouse Management (EWM), designed to help organizations run their warehouse operations more efficiently.

Posted March 22, 2023

DataRobot is releasing DataRobot AI Platform 9.0, featuring deeper partner integrations, AI Accelerators, and redesigned service offerings, all centered on helping organizations derive value from their AI investments. The DataRobot AI Platform allows customers to leverage Value-Driven AI, a unique and collaborative approach that improves how organizations run, grow and optimize their business, according to the vendor.

Posted March 22, 2023

Observability by definition is a measure of how well internal states of a system can be inferred from knowledge of its external outputs. In other words, a system's behavior is determined from its outputs—information obtained by certain measures. Though observability as a term has been used for many years, the modern understanding originates in software observability, which is the ability to collect data about program execution, internal states of modules, and communication between components.

Posted March 22, 2023

KX is expanding its partnership with Microsoft, now offering kdb Insights Enterprise on Microsoft Azure. According to KX, this represents an industry-first Data Timehouse, a new class of data and AI management platform designed for temporal data generated by digital transformation.

Posted March 21, 2023

Strata Identity, the Identity Orchestration company, is releasing Orchestration Recipes that will enable organizations to automate the migration from any legacy identity system to any cloud identity provider (IDP) without rewriting any code using the Maverics multi-cloud Identity Orchestration platform. The recipes support moving off outdated IDPs to more secure and flexible cloud identity systems like Okta, Microsoft Azure AD, AWS Cognito, and more.

Posted March 20, 2023

TrueFort, the lateral movement protection company, is launching the TrueFort Trust Partner Program for IT solution providers, systems integrators, consultants, MSPs/MSSPs, and ISVs. The program will deliver custom workload, lateral attack, and microsegmentation security solutions using a channel friendly model that allows partners to capitalize on new market opportunities to generate new recurring revenue streams.  

Posted March 20, 2023

LicenseFortress, Inc., an independent software asset management provider, is introducing Database Insight as an add-on to the ArxPlatform, further strengthening its partnership with Application Performance Ltd. The ArxPlatform leverages intelligent, real-time software license compliance monitoring and alerting for Oracle, Microsoft, and VMware. The addition of Database Insight will provide optimization for how database licenses are used, as well as unlocking hosting and cloud platform savings, according to the company.

Posted March 17, 2023

The world is becoming increasingly digital every day and, as a result, even more data-driven. The datasphere is experiencing stunning growth, with 90% of all data being created over just the past two years. This explosive growth is something that will only continue in the future, and it's clear that as companies begin to amass more and more data, they need to take a hard look at their data management practices.

Posted March 16, 2023