Data Warehousing

Hardware and software that support the efficient consolidation of data from multiple sources in a Data Warehouse for Reporting and Analytics include ETL (Extract, Transform, Load), EAI (Enterprise Application Integration), CDC (Change Data Capture), Data Replication, Data Deduplication, Compression, Big Data technologies such as Hadoop and MapReduce, and Data Warehouse Appliances.

Data Warehousing Articles

Not many companies have the opportunity to take a greenfield approach to data architecture. Most have "accidental architectures" that were never really intentionally designed at all, but instead have been built up over time across different eras of data management, according Rick Sherman, managing partner of Athena IT Solutions. But fragmented architectures can still be improved, says Sherman, who will present a talk titled "Designing a Data Architecture for Modern Business Intelligence and Analytics" at Data Summit.

Posted March 19, 2018

Today, the average enterprise is being flooded with data streams as they come in from a variety of endpoints from smart devices and sensor networks, to web logs and financial transactions. DBTA recently held a webinar featuring Brian Bulkowski, co-founder and CTO, Aerospike, and Dan Potter, VP product management and marketing, Attunity, to educate its readers about the key ingredients for success in building a fast data system.

Posted March 16, 2018

Companies are collecting vast troves of information about their customers today, but to leverage the full value of that information they need the right tools and technologies, according to Zak Pines, VP-Marketing, Bedrock Data, who will present a session at Data Summit titled "Overcoming Data Silos to Get a Unified View of Customers."

Posted March 16, 2018

Every organization is unique. So is every Oracle user. Enter COLLABORATE 18: Technology and Applications Forum for the Oracle Community (April 22-26 in Las Vegas). Designed to serve the evolving educational needs of today's users, COLLABORATE offers 12,00 informative sessions and events carefully selected by volunteers, Oracle pros themselves, from a global call for content. While there's no "one-size-fits-all," there is something for everyone.

Posted March 14, 2018

Presented once each year by three major Oracle users groups—Independent Oracle Users Group, Oracle Applications Users Group, and Quest International Users Group—COLLABORATE is one event focused solely on the spectrum of Oracle technologies and solutions that you can count on to get information from experts and fellow users about practical implications, real-world case use cases, how to benefit from new solutions, and overcome difficulties you may be having.

Posted March 14, 2018

An abundance of database types are flourishing so much so that those who tout "polyglot persistence" insist that one size cannot fit all and focus on integrating multiple data stores. However, multi-model databases are also on the rise and may be a better fit than using multiple data stores. Jeff Fried, CTO, BA Insight will discuss the pros and cons of both approaches at Data Summit 2018 during his session titled, "Polyglot Persistence Versus Multi-Model Databases."

Posted March 14, 2018

BMC, a provider of IT solutions for the digital enterprise, is expanding its Control-M Managed File Transfer offering to include support for all file transfers from a single automation platform. With BMC's Control-M solution, companies have instant visibility into the status of file transfers and business application workloads.

Posted March 09, 2018

It's time to submit nominations for the annual Database Trends and Applications Readers' Choice Awards Program in which the winning information management solutions, products, and services are chosen by you—the people who actually use them. This year, there are 29 categories in which to submit nominations.

Posted March 07, 2018

DBAs may think that machine learning cannot possibly perform all of their tasks and but it is entirely feasible and likely that the machine learning functionalities will perform all of the tasks of an operational DBA - or will very soon, writes Eric Mader in the fourth installment of a six-part article series by editors of IOUG SELECT and Big Data Quarterly on "The Changing Role of the Modern DBA."

Posted March 07, 2018

The term "big data" has been bandied about for a number of years now, to the point where it has been used so much that it is a part of IT culture. Hard to specifically define, yet everyone seems to have a good idea what is meant by it, big data is here to stay. And that is a good thing!

Posted March 07, 2018

Startups with a mission to address an unanswered problem continue to emerge in the tech sector. These companies tap into new and still emerging technologies such as cloud, IoT, machine learning, containerization, AI, NoSQL, and blockchain to provide fresh solutions that simply were not possible before.

Posted March 07, 2018

A new Unisphere Research survey sponsored by Quest Software looks at the changing role of the DBA in light of new challenges in database administration ("DBAs Face New Challenges: Trends in Database Administration"). For years, DBAs' primary responsibilities have been aimed at ensuring that data is safely, securely, accurately, and appropriately stored, managed, and maintained. However, with the rise of new data types and increasing data volumes, data environments are changing, and so, too, are the roles of DBAs.

Posted March 05, 2018

MariaDB Corporation is creating a research division that tackles the most extreme challenges in the database field and will partner with Intel on its inaugural initiative. Dubbed MariaDB Labs, the division will bring together world-class experts and industry leaders to make discoveries that spawn new use cases.

Posted February 26, 2018

Qubole, which provides cloud big data-as-a-service, and Snowflake Computing, which provides a data warehouse built for the cloud, are partnering to enable customers to use Apache Spark in Qubole with data stored in Snowflake.

Posted February 22, 2018

It's no secret that data management has changed dramatically in the nearly 10 years since the onslaught of "big data." A decade ago, the relational database management system (RDBMS) ruled the enterprise.  Today, polyglot persistence is the mandate, and innovative NoSQL and NewSQL databases, cloud services, and data processing technologies have arisen alongside stalwart RDBMSs, data warehouses, and traditional on-premise deployments. However, despite the increasingly challenging data environment, experts agree, opportunities for DBAs abound—provided they are willing to continue learning and growing and to step in to fill gaps where they open up.

Posted February 22, 2018

At CloudWorld in New York, Oracle CEO Mark Hurd provided an overview of the state of the IT market and offered four predictions for the enterprise technology changes that can be expected by 2020-2025.

Posted February 21, 2018

The worldwide cognitive systems and artificial intelligence revenue has been forecast to grow beyond $47 billion in 2020, changing how we live and work dramatically. Will you be ready? Cognitive Computing Summit is coming to Boston in May to provide a 2-day immersion into the cognitive computing use cases, strategies, and software that every organization should know about now. 

Posted February 09, 2018

Oracle has announced the Oracle Database Security Assessment Tool (DBSAT) to help organizations assess the security configuration of their databases, identify sensitive data, and evaluate database users for risk exposure.  

Posted February 07, 2018

DH2i, a provider of multi-platform disaster recovery and cost improvement solutions, is being added to Microsoft's SQL Server High Availability and Disaster Recovery Partners List. The SQL Server High Availability and Disaster Recovery Partner List includes DH2i's DxEnterprise software, a unified Windows and Linux Smart Availability solution for databases and stateful Docker containers. 

Posted February 05, 2018

It's no secret that data management has changed dramatically in the nearly 10 years since the onslaught of "big data." Nonetheless, experts agree, there has never been a better time to be a DBA—provided you are willing to continue learning and growing and to step in to fill gaps where they open up.

Posted February 05, 2018

The industrial revolution has given way to the digital age but, how do traditional factories weather the storm of this change? Modern demands require manufacturers to have the ability to support faster production, vary product output at a moment's notice, lower power consumption, and eliminate waste all while improving throughput and efficiency.

Posted February 02, 2018

An astounding array of new technologies and approaches have emerged on the database scene over the past few years that promise to turn the next 12 months into a time of unprecedented transformation for the database landscape. There are new developments, along with reinforcement of tried-and-true technologies, some of which may help make the jobs of data managers just a bit easier.

Posted February 01, 2018

A new study conducted by Unisphere Research and sponsored by Quest Software examines the challenges being faced by database administrators (DBAs) and other data professionals who have long been the key guardians of companies' critical data assets. DBAs' primary responsibilities have been aimed at ensuring that data is safely, securely, accurately, and appropriately stored, managed, and maintained. However, over the last 10 years, major trends in technology have shaped—and reshaped—the ongoing role of the DBA in many organizations, according to the study, "DBAs Face New Challenges: Trends in Database Administration."

Posted January 25, 2018

The CTO of a major database vendor recently stated at a conference that basically DBAs would soon be out of a job. The gist of the keynote was autopilot flies better than humans, autonomous cars will be safer, so why would we not do the same for our databases (remove the human error)? What is the validity of this line of thought, and how might it be implemented? What does an autonomous database look like?

Posted January 24, 2018

IBM and Salesforce, a provider of CRM, are expanding their strategic partnership, bringing together IBM Cloud and Watson services with Salesforce Quip and Salesforce Service Cloud Einstein. The move will enable companies to connect with their customers and collaborate more effectively with deeper insights.

Posted January 19, 2018

Modern data warehousing is not only being shaped by the need for businesses to deliver data faster to more users, but the need for a richer picture of their operations afforded by a greater variety of data for analysis. A growing number of organizations are modifying their data warehouse infrastructures with new technologies, from in-memory databases to Hadoop - and a flourishing market of cloud solutions.

Posted January 08, 2018

Today's modern enterprise data warehouse (EDW), which has been in existence for more than 20 years, faces a growing set of challenges. The platform must incorporate data integration, quality, and governance effectively.

Posted January 05, 2018

With a new year comes new ideas on how to disrupt the big data industry. From tried and true methods to the introduction of new solutions, several experts are predicting a surge of a combination of both old and new solutions, along with the rise of different roles that will power enterprises through 2018.

Posted January 04, 2018

Data lakes are often viewed as the ultimate silo breakers, integrating mountains of data frompoint solutions for ERP, CRM, enterprise data warehouse, cloud and on-premises applications.However, if the enterprise data lake is not leveraged appropriately, it often ends up being just adata dump or worse still a "data swamp."

Posted January 02, 2018

Self-service data discovery has been the buzz word in the BI industry for the past 3 years and is touted as the solution to many problems. Yet, the BI industry has a dismal adoption rate of only 22%, which has plagued the industry for several years. In response to this grim number, we must look around for a solution in other sectors that provides self-service to millions of people without any IT support. In essence, we are looking for a self-service paradigm that can give us insights about how to solve the adoption challenge and learn from it.

Posted January 02, 2018

Don't let the term "unstructured data" confuse you. Structure exists, somehow and somewhere, within unstructured source data. It is that subtle, possibly even encrypted, structure that contains the gems of knowledge that an enterprise seeks. Sometimes those gems only shine when extracted and combined with other little gems from other data sources.

Posted January 02, 2018

New technologies and solutions are giving businesses new avenues to to deliver a competitive edge. From startups to Fortune 100 companies, success means increasing efficiency, agility and innovation through better collaboration, visibility, and performance.

Posted December 22, 2017

Transforming data into valuable information your enterprise can use sometimes is a daunting task. However, it doesn't have to be. In a recent DBTA webinar, Donald Soulsby, VP of architecture strategies at Sandhill Consultant, and Jeff Harris, technical services manager at Sandhill Consultant, discussed how to survive and thrive with data intelligence.

Posted December 21, 2017

More and more organizations are moving their data to the cloud to capitalize on cost-efficiencies and time-to-value opportunities. The technologies underpinning big data and cloud computing are converging and offering businesses new capabilities for fast, easy, wide-ranging data access. However, only if integrated and managed properly.

Posted December 04, 2017

There never has been a more interesting time to be involved in the data management field. Data not only has become "the new oil" but is also the catalyst that is powering organizations to new heights of success. The past year has seen the rise of powerful analytics and an embrace of new tools and platforms emerging to more effectively tap into the power that data offers. DBTA reached out to industry experts to document the most important trends shaping data management in 2018.

Posted December 01, 2017

This year's PASS Summit packed more than 5,000 data professionals into the Washington State Convention Center for hardcore technical sessions covering all aspects of the Microsoft data platform. Here are some highlights.

Posted December 01, 2017

Confluent, provider of the streaming platform based on Apache Kafka, is releasing Confluent Cloud, allowing users to manage large streaming environments. The fully managed service helps companies deploy their Customer 360, fleet management, fraud detection, and other real-time, large-scale initiatives.

Posted November 29, 2017

Snowflake Computing has announced the public preview of Snowpipe, an automated service to load data into the Snowflake cloud data warehouse, that is built using Amazon SQS and other Amazon Web Services (AWS) solutions.

Posted November 29, 2017

Cloudera has announced the upcoming beta release of Cloudera Altus Analytic DB, a data warehouse cloud service that aims to bring the warehouse to the data through a cloud-scale architecture to eliminate costly data movement.

Posted November 28, 2017