Data Warehousing

Hardware and software that support the efficient consolidation of data from multiple sources in a Data Warehouse for Reporting and Analytics include ETL (Extract, Transform, Load), EAI (Enterprise Application Integration), CDC (Change Data Capture), Data Replication, Data Deduplication, Compression, Big Data technologies such as Hadoop and MapReduce, and Data Warehouse Appliances.

Data Warehousing Articles

It's time to submit nominations for the annual Database Trends and Applications Readers' Choice Awards, a competition in which the winning information management solutions, products, and services are selected by you, the users.

Posted February 08, 2023

KX, maker of kdb+, and EnterpriseWeb, a provider of telecom virtualization and automation solutions, are partnering to deliver network observability and automation solutions for performance-critical systems. Bringing together highly complementary technologies, KX and EnterpriseWeb offer an incredibly flexible and powerful closed-loop control mechanism that can be deployed on any system or distributed network, according to the vendors.

Posted January 26, 2023

Ensono, an expert technology advisor, innovation partner, and managed service provider, is releasing Ensono Envision Advisor, a multi-platform optimization solution combining data and guidance from certified expert engineers who offer unbiased actionable advice that enables optimization of a client's IT estate across cost, security, performance, availability, and reliability.

Posted January 26, 2023

Forward Networks announced that it has secured $50 million in Series D funding, enabling the company to continue investing in its digital twin network modeling software that delivers security, reliability, and agility to large enterprise networks. The funding round, led by MSD Partners, L.P., includes new investors Section 32 and Omega Venture Partners as well as existing investors Goldman Sachs Asset Management (Goldman Sachs), Threshold Ventures, A. Capital, and Andreessen Horowitz. Additionally, Victor Hwang, managing director and co-head of MSD Growth, joins the Forward Networks board of directors.

Posted January 25, 2023

SAP and Amazon Web Services (AWS) are collaborating to accelerate digital transformation to support their customers, building on the success of their longstanding partnership. The collaboration brings together the technology, solutions, and flexibility that customers need to help them succeed in the digital economy, according to the vendors. The companies have had a strategic relationship for more than a decade with thousands of customers.

Posted January 25, 2023

Introduced in a DBTA webinar, "Exploring Amazon DocumentDB Elastic Clusters," Vin Yu, senior technical product manager at AWS, highlighted DocumentDB's new elastic clusters feature which allows users to quickly scale and support massive read and writes workloads, all while mitigating cost and alleviating menial administrative labor.

Posted January 19, 2023

Kintent, the programmatic, predictive Trust Assurance platform, is releasing its new TrustShare application, allowing software companies to pass security reviews quickly with AI-powered security questionnaire responses while also offering a dynamic trust portal to share security and privacy compliance status with prospects and partners.

Posted January 19, 2023

Styra, Inc., the creator and maintainer of Open Policy Agent (OPA) and leader of cloud-native authorization, is adding the industry's broadest policy library and toolset for infrastructure to its Styra Declarative Authorization Service (DAS). To address security concerns associated with the use of containers, Styra now provides NIST Special Publication (SP) 800-190 compliant policies within its expanded library that includes hundreds of validated policies.

Posted January 18, 2023

Cisco and Intel are releasing the 7th generation of UCS C-Series and X-Series servers that will be powered by 4th Gen Intel Xeon Scalable processors, providing customers with greater flexibility and more performance for modern workloads with new C-Series and X-Series servers.

Posted January 17, 2023

Uncertain economic conditions, skills shortages, rising automation, increasing regulation, and digital disruption—all add up to a stew of both challenges and opportunities for data managers in the year ahead. Emerging technologies—and new attitudes—are reshaping the look and scope of the information management landscape, with implications for overall business strategies and individual careers alike.

Posted January 12, 2023

Moving to the cloud may seem, on its surface, a good way to better manage the quality and viability of data resources for enterprises. However, as data accelerates its move to the cloud, the complexity involved in assuring quality and viability has only increased.

Posted January 12, 2023

Data integration technologies, capabilities, and methodologies are evolving. It can be difficult to figure out what solutions or approaches may be best for the business and its digital transformation. Informatica recently held a special webinar titled "Data Integration Trends for 2023," with Makesh Renganathan, director product management, Informatica, and John O'Brien, principal advisor and CEO, Radiant Advisors, to discuss data integration trends to improve data management.

Posted January 11, 2023

For the eighth consecutive year, Amazon Web Services is named a leader in Gartner's annual "Magic Quadrant" rankings for the cloud database space. The new rankings, which evaluate the world's top 20 data and analytics companies, have elevated AWS into first place as the leader in vision, as well as ability to execute. At its recent re:Invent conference, the company unveiled a new generation of enhancements which introduce greater performance and integration to its cloud-based databases services.

Posted January 10, 2023

In the ever-shifting markets professionals work in today, companies must have the ability to remain agile and flexible throughout their business operations. To combat the uncertainties of the marketplace and customer demands for fast service, businesses have turned to open-source technology over the past decade. Open-source technologies provide IT and development teams with the agility to implement innovative tools and practices—such as DevOps and Continuous Integration and Continuous Delivery (CI/CD).

Posted January 09, 2023

A special registration period for Data Summit 2023 is now open. Take advantage of the best deal of the year with Super Early Bird savings off your pass. While we finalize the program, you can save big with $300 off the regular rate of our most popular passes. Preferential pricing is offered to attendees who register before January 20. Additionally, worry free registration is available through February 10.  

Posted January 06, 2023

Progress, trusted provider of application development and infrastructure software, announced it is entering a definitive agreement to acquire MarkLogic, a provider of managing complex data and metadata and a Vector Capital portfolio company. Upon closing of the planned transaction, MarkLogic is expected to enhance Progress' commitment of delivering the best products to develop, deploy, and manage high-impact applications by providing a unified enterprise-grade semantic data platform that empowers customers to derive value from complex data.

Posted January 04, 2023

OneQode, global Infrastructure-as-a-Service (IaaS) company, is joining the Oracle PartnerNetwork (OPN), providing enhanced offerings to enterprise customers in the Asia-Pacific region, with a particular focus on gaming, virtual and augmented reality, and other high-performance applications.

Posted January 04, 2023

According to a new research report published by Information Services Group (ISG), a leading global technology research and advisory firm, many U.S. enterprises are migrating to Oracle cloud infrastructure and applications. The 2022 ISG Provider Lens Oracle Ecosystem report for the U.S. finds that enterprises are investing in Oracle Cloud Applications (OCA) for its ability to scale and its integrated application and infrastructure stack.

Posted January 04, 2023

Oracle is opening an Oracle Cloud Region in Chicago, Illinois, continuing one of the fastest expansions of any major cloud provider. Oracle's 41st global region and fourth in the U.S. offers customers and partners a new option to locate their infrastructure, applications, and data for optimal performance and latency.

Posted January 04, 2023

Mike Hulme, VP of marketing at DataStax and George Trujillo, principal data strategist at DataStax joined DBTA to explore the ways in which the real-time data cloud can provide key advantages that rival the cost, complexity, and performance of legacy systems.

Posted January 03, 2023

LogRhythm, the company empowering security teams, is partnering with SentinelOne, an autonomous cybersecurity platform company, to offer an integrated enterprise security solution to prevent, detect, and respond to threats in your environment. The combined solution streamlines security operations and improves response workflow, helping overwhelmed security teams cut through the noise and gain precise insights into cybersecurity threats, according to the vendors.

Posted December 21, 2022

From cloud to AI and onto new technologies and methodologies such as DataOps, another year means more solutions to choose from. Here, executives of leading companies provide predictions for what's ahead in 2023 for big data. Plans for 5G deployments, new AI technologies like the metaverse or digital twins, and the rise of data fabric and data mesh are just some of the latest trends experts see coming to fruition in 2023.

Posted December 20, 2022

Redgate Software, a database DevOps solutions provider, announced it will releases a series of upcoming enhancements to its portfolio which will help organizations and businesses standardize and streamline cross-database development. According to the company, it was prompted by the growing use of different database types within IT departments and the increase in Open Source adoption. The move will reduce the difficulties faced when managing the development and deployment of changes across multiple database platforms at the same time.

Posted December 19, 2022

Ellen Mary Challans, better known by her pen name Mary Renault, was attributed with saying, "There is only one kind of shock worse than the totally unexpected: the expected for which one has refused to prepare." The early years of the second decade of the 21st millennium have been scarred by the consequences of willful negligence cascading throughout the world due to the inconvenience of nonchalantly ignoring unexpected inevitabilities.

Posted December 15, 2022

More and more companies are looking to cloud databases to offload an abundance of data and analytics. This upcoming year looks no different as organizations continue to adapt to an ever-changing landscape. Here tech leaders share their predictions for cloud in 2023.

Posted December 15, 2022

Ambee announced its seven environmental data products are now available on the Data Marketplace for SAP Data Warehouse Cloud. By delivering accurate and reliable environmental data, Ambee helps enable global businesses, administrations, and individuals to get better access to environmental data and drive towards sustainable innovation.

Posted December 14, 2022

To say the past year has been interesting for data managers and professionals is an understatement. Intensifying efforts to achieve data-driven processes, escalating security issues, shifts toward graph and cloud databases, and supply chain turbulence have dominated data teams' task lists. The coming year will be no different.

Posted December 13, 2022

MANTA brings intelligence to metadata management by providing a data lineage platform that automatically scans your data environment to build a powerful map of all data flows and deliver it through a native UI and other channels to both technical and non-technical users. With MANTA, everyone gets full visibility and control of their data pipeline.

Posted December 12, 2022

Today's data environments are highly diverse—residing on many platforms and requiring a variety of approaches to ensure data resiliency and availability. Delivering technology alone will not be enough in 2023. To help make the process of identifying useful products and services easier, each year, DBTA presents a list of Trend-Setting Products. These products, platforms, and services range from long-established offerings that are evolving to meet the needs of their loyal constituents, to breakthrough technologies that may only be in the early stages of adoption.

Posted December 08, 2022

The British royal family safeguards its crown jewels—the treasures held by the English monarchy comprising more than 100 objects estimated to be worth billions—with world-class security systems, including two-ton steel doors and bomb-proof glass. When the crown jewels are transported or moved, such as for a royal wedding or the recent coronation ceremony, they are guarded closely by elite, ex-military members at all times—with access restricted to only a few security-cleared individuals.

Posted December 08, 2022

Modern applications have increasingly leveraged Kubernetes as the "OS of the cloud" because of its ability to abstract the underlying cloud platform and coordinate the activities of multiple docker containers. Kubernetes does indeed radically simplify the deployment and administration of multi-service distributed applications. However, it has a significant learning curve, and maintaining a largescale Kubernetes cluster can be daunting.

Posted December 08, 2022

Readers of this column sometimes ask me questions about databases and database administration, which I welcome. And at times I will take the opportunity to answer particularly intriguing questions in print. One intriguing question I have been asked more than once is: "What metrics and measurements are useful for managing how effective your DBA group is?"

Posted December 08, 2022

Often data is categorized into very high-level groupings of structured or unstructured. Generally, structured data is considered data that conforms to an easily identifiable pattern and as part of this conforming, that data may be easily loaded into a relational database table "as is." Examples of this might be fixed-format files, or comma-separated files having an agreed upon pattern to each record within it. Unstructured data supposedly cannot be loaded "as is" into a relational table. Unstructured data is, by name, lacking an identifiable structure to make sense of the data, right? Not exactly.

Posted December 08, 2022

Cybersecurity and threat detection continues to be top of mind moving into 2023. Data breaches and the capture of sensitive information remain concerns for organizations large and small. Here, data security leaders share their thoughts on what lies ahead as companies seek the best resources to secure data and thwart bad actors.

Posted December 07, 2022

Twelve Labs, the video search and understanding company, announced several product advances along with closing on a $12 million seed extension round, following its initial seed fundraise last spring. To help ensure that speed and quality are not compromised, Twelve Labs has chosen Oracle to provide the AI cloud infrastructure capacity required to bring its foundation AI model to market.

Posted December 07, 2022

Quest Software creates and manage software that makes the benefits of new technology real while empowering users and data, streamlining IT operations, and hardening cybersecurity from the inside out. Looking ahead to a new year several experts at Quest are offering their predictions for 2023.

Posted December 07, 2022

The call for speakers is open for the 10th annual Data Summit conference, to be held in Boston, May 10-11, 2023, with pre-conference workshops on May 9, 2023. The Data Summit conference focuses on the business and technical aspects of Data Management, Analytics, Artificial Intelligence, Machine Learning, Data Architecture, and Emerging Technologies.

Posted December 06, 2022

Airbyte, an open-source integration provider, is unveiling its expanded partnership with dbt Labs, an analytics engineering company, accompanied by a new integration to enable dbt Cloud customers to schedule and initiate dbt jobs from within Airbyte Cloud.

Posted December 06, 2022

ClickHouse, Inc, creator of an online analytical processing (OLAP) database management system, announced the general availability of their newest offering, ClickHouse Cloud. The platform promises a lightning-fast cloud-based database that simplifies and accelerates insights and analytics for modern digital enterprises.

Posted December 06, 2022

Striim, Inc., announced the availability of Striim Cloud on Amazon Web Services (AWS), giving users access to a fully-managed, unified software-as-a-service (SaaS) platform for real-time streaming data integration and analytics from both on-premise or hybrid cloud mission-critical applications.

Posted December 05, 2022

Equalum, provider of data integration and ingestion solutions, is announcing its strategic partnership with Yellowbrick Data, the hybrid multi-cloud data warehouse vendor. By streamlining the data migration process with Equalum's platform, data is moved from legacy environments to the Yellowbrick Data Warehouse—which is hosted in the user's commercial cloud environment of choice.

Posted December 02, 2022

A renewed interest in data-centric AI is driving increased model outcome accuracy and introducing the concept to new applications. Data-centric AI is gaining momentum as engineers working with AI shift their focus from models to data. Whereas engineers previously took a model-centered approach to improve the prediction outcomes and accuracy of a model, current dynamics are causing many to look to the quality of input data to improve outcomes.

Posted December 01, 2022

Global technology solutions company Unisys Corporation and multi-cloud data services company Faction announced they will jointly offer an end-to-end solution for fully-managed data protection, cyber recovery, and business continuity services in both on-premises and multi-cloud environments.

Posted December 01, 2022

Synatic, a provider of data integration and automation, announced it has secured an additional $2.5 million in a seed extension funding round, enabling the company to expand its market reach in the United States in preparation for Series A funding early in 2023.

Posted November 30, 2022

Databricks is releasing MLflow 2.0, building upon MLflow's strong platform foundation and incorporating extensive user feedback to simplify data science workflows and deliver innovative, first-class tools for MLOps. Features and improvements include extensions to MLflow Recipes (formerly MLflow Pipelines) such as AutoML, hyperparameter tuning, and classification support, as well modernized integrations with the ML ecosystem, a streamlined MLflow Tracking UI, a refresh of core APIs across MLflow's platform components, and much more.

Posted November 29, 2022

Cameron O'Rourke, senior director of product strategy at Incorta, and Eldad Chai, CEO of Satori, gathered for a DBTA webinar, "Top Trends in Data Engineering," to discuss key patterns and methods that illuminate what areas of data and analytics need some technological TLC.

Posted November 22, 2022