Newsletters




Data Warehousing

Hardware and software that support the efficient consolidation of data from multiple sources in a Data Warehouse for Reporting and Analytics include ETL (Extract, Transform, Load), EAI (Enterprise Application Integration), CDC (Change Data Capture), Data Replication, Data Deduplication, Compression, Big Data technologies such as Hadoop and MapReduce, and Data Warehouse Appliances.



Data Warehousing Articles

The call for papers is now open for the first-ever Big Data Boot Camp produced by Database Trends and Applications (DBTA) magazine and www.dbta.com. The event, which will take place May 21-22 at the New York Hilton, will provide the opportunity for speakers to share their knowledge and experience in the emerging big data arena.

Posted January 24, 2013

Databases are hampered by a reliance on disk-based storage, a technology that has been in place for more than two decades. Even with the addition of memory caches and solid state drives, the model of relying on repeated access to the permanent information storage devices is still a bottleneck in capitalizing on today's "big data," according to a new survey of 323 data managers and professionals who are part of the IOUG. Nearly 75% of respondents believe that in-memory technology is important to enabling their organization to remain competitive in the future. Yet, almost as many also indicate they lack the in-memory skills to deliver even current business requirements. The research results are detailed in a new report, titled "Accelerating Enterprise Insights: 2013 IOUG In-Memory Strategies Survey."

Posted January 23, 2013

MicroStrategy Inc., a business intelligence software vendor, has certified its integration with the Amazon Redshift data warehouse service, a cloud-based service designed to deliver high performance analytics for data warehouse and big data applications. "A big part of the value we perceive with Redshift is that it takes advantage of the cloud to really deliver a very impressive price-performance ratio that is compelling for a lot of different use cases," Kevin Spurway, MicroStrategy's vice president of cloud and strategic marketing, tells DBTA. MicroStrategy is one of the first vendors to certify integration with Amazon Redshift.

Posted December 19, 2012

Despite the rise of big data, data warehousing is far from dead. While traditional, static data warehouses may have indeed seen their day, an agile data warehouse — one that can map to the needs of the business and change as the business changes — is quickly on the rise. Many of the conversations today around big data revolve around volume and while that is certainly valid, the issue is also about understanding data in context to make valuable business decisions. Do you really understand why a consumer takes action to buy? How do their purchases relate? When will they do it again? Big data is limited when it comes to answering these questions. An agile approach — one that gives even big data a life beyond its initial purpose — is the value data warehousing can bring to bear and is critical to long-term business success.

Posted December 19, 2012

The University of Minnesota, a top research institution comprised of five campuses, 65,000 students and 25,000 employees, has made systematic changes and improved database administration efficiency with Oracle Exadata Database Machine. By hosting its IT environment on two Oracle Exadata Database Machine half racks, the university consolidated more than 200 Oracle database instances into fewer than 20, enabling it to reduce data center floor space and total cost of ownership.

Posted December 12, 2012

At OpenWorld, Oracle's annual conference for customers and partners, John Matelski, president of the IOUG, and CIO for Dekalb County, Georgia, gave his perspective on the key takeaways from this year's event. Matelski also described the user group's efforts to help the community understand the value of Oracle's engineered systems and deal with the broad implications of big data, and how the IOUG is supporting Oracle DBAs in their evolving roles.

Posted December 12, 2012

Tervela Turbo is now certified on CDH4 (Cloudera's Distribution Including Apache Hadoop Version 4). Introduced in October, Tervela Turbo, a high-performance data movement engine, helps Cloudera customers implement mission-critical Hadoop systems with reliable data capture, high-speed data loading into HDFS, disaster recovery for Hadoop, and ETLT data warehousing. Tervela has also joined the Cloudera Connect Partner Program.

Posted December 12, 2012

Amazon Web Services Inc. has announced the limited preview of Amazon Redshift, a managed, petabyte-scale data warehouse service in the cloud, which aims to enable customers to increase the speed of query performance when analyzing data sets using the same SQL-based BI tools they use today. "Over the past 2 years, one of the most frequent requests we've heard from customers is for AWS to build a data warehouse service," says Raju Gulabani, vice president of Database Services, AWS.

Posted November 28, 2012

Big data is here, offering both vast opportunities — as well as vexing challenges — for every organization it touches. For a number of years, it has been understood that to be of value, information needs to be readily available, as close to real time as possible, to users in any location. Now, with the onset of "big data," the task gets more daunting. "These are all increasing the demands on both transactional and analytics data systems," says Bernie Spang, director of database software and systems for IBM.

Posted November 27, 2012

Jeff West, president of Quest International Users Group, joined by Jonathan Vaughn, Quest's executive director, talked with DBTA at Oracle OpenWorld about what's ahead for 2013. The group has launched smaller, product-concentrated events to support JD Edwards and PeopleSoft users' specific areas of interest, and expanded its range of online offerings for users who may not be able take advantage of in-person conferences. Plans are underway to help members learn about PeopleSoft 9.2 coming in March and to prepare for the looming end of support for JD Edwards World. As always, says West, Quest continues to help get information to members from Oracle and their peers. "It is always about return on investment and aligning IT with the business. That is always on the top of people's minds."

Posted November 27, 2012

MapR Technologies, Inc., provider of the MapR Distribution for Hadoop, has formed a partnership with Hadapt, which offers a data analytics platform for natively integrating SQL with Apache Hadoop. The partnership enables customers to leverage MapR's Hadoop distribution in conjunction with Hadapt's Interactive Query capabilities to analyze all types of data, structured, semi-structured and unstructured, in a single, enterprise platform. Partnerships such as the one with Hadapt enable a broad community of users to have access to Hadoop data while also leveraging the existing skill sets of those users, Jack Norris, vice president of MapR, tells 5 Minute Briefing.

Posted November 15, 2012

Cloudera, provider of Apache Hadoop-based software and services, announced the first big data management solution that allows batch and real-time operations on any type of data within one scalable system. Cloudera Enterprise Real-Time Query (RTQ), powered by Cloudera Impala, improves the economics and performance of large scale enterprise data management, allowing organizations to process data at petabyte scale and interact with that data in real time all on the same system.

Posted November 06, 2012

Open source software vendor Talend announced that it has added big data profiling for Apache Hadoop and support for NoSQL databases in the upcoming release of its integration platform, Talend v5.2. Data profiling, the process of evaluating the character and condition of data stored across the enterprise, is a critical step toward gaining control over organizational data, and is emerging as a big data best practice. "Profiling allows you to understand what you have in your Hadoop cluster and how this data can be used for your big data integration and management project," Yves de Montcheuil, Talend's vice president of marketing, tells 5 Minute Briefing.

Posted November 06, 2012

Attunity Ltd., a provider of information availability software solutions, is partnering with Teradata to offer Attunity Replicate for Teradata, a big data replication solution designed to enable loading of heterogeneous data to Teradata with high performance, efficiency and ease-of-use.

Posted October 25, 2012

Kognitio is allowing companies to download a fully functional copy of its software at no charge, and with no time restrictions. The company, which made the announcement at O'Reilly Strata and Hadoop World conference, said it is offering a full-featured, perpetual use license of up to 128 gigabytes without an expiration period or other limited functions normally found in "trialware." This capability gives companies the ability to do in-memory analytics on, for example, more than 500 million customer records at once.

Posted October 25, 2012

At SAP TechEd 2012 in Las Vegas, SAP unveiled its plans for SAP HANA Cloud, a next-generation cloud platform based on in-memory technology. As part of SAP HANA Cloud, the company also announced the general availability of SAP NetWeaverCloud, an open standards-based application service, and SAP HANA One, a deployment of SAP HANA certified for production use on the Amazon Web Services (AWS) Cloud, as the first offerings based on SAP HANA Cloud.

Posted October 24, 2012

Oracle CEO Larry Ellison laid out four key products in his opening keynote at Oracle OpenWorld this year. The announcements - all related to the cloud - include an Oracle IaaS offering in addition to PaaS and SaaS; the addition of an Oracle Private Cloud option; Oracle Database 12c; and the new Exadata X3.

Posted October 24, 2012

The opportunities and challenges presented by big data are addressed in a new report summarizing the results of a survey of data managers and professionals who are part of the Independent Oracle Users Group. The survey was underwritten by Oracle Corporation and conducted by Unisphere Research, a division of Information Today, Inc. Key highlights from the survey include the finding that more than one out of 10 data managers now have in excess of a petabyte of data within their organizations, and a majority of respondents report their levels of unstructured data are growing.

Posted October 24, 2012

Survey respondents to the IOUG Big Data survey were entered into a drawing to win an iPad by providing their email addresses. The winner of the iPad in the recent IOUG Big Data study sweepstakes drawing was Thomas F. Lewandowski, an independent Oracle DBA.

Posted October 24, 2012

SAP AG announced the availability of the SAP Precision Retailing solution, which is designed to help companies reach consumers at the moment of decision. The enterprise solution delivers personalized offers and suggestions in real time to consumers across multiple channels, including mobile devices, in-store kiosks and websites. "The solution we just launched bridges the gap between the consumer at the point of decision who needs to make a purchase and the ocean of data - and we extract the needle in the haystack - that piece of information that will help the consumer make a decision," Herve Pluche, vice president, Retail Consumer Mobile Initiative, SAP Labs, tells 5 Minute Briefing.

Posted October 11, 2012

Attunity Ltd., a provider of information availability software solutions, has introduced Attunity Replicate for Exadata, a new data replication solution designed to enable quick loading of big data into and out of Oracle Exadata. The solution further expands Attunity's reach into the big data market and features targeted optimizations that result in high performance and rapid implementation.

Posted October 10, 2012

Are today's data systems — many of which were built and designed for legacy systems of the past decade — up to the task of moving information to end users at the moment they need it? And is this information timely enough? In many cases, there's a lot of work that still needs to be done before real-time information, drawn from multiple sources, becomes a reality. A new survey of 338 data managers and professionals who are subscribers to Database Trends and Applications reveals that real-time data access is still a distant pipe dream for at least half of the companies represented in the survey. The survey, conducted by Unisphere Research, a division of Information Today, Inc., in partnership with Attunity in March of 2012, finds that close to half of the survey respondents, 48%, report that relevant data within their organizations still take 24 hours or longer to reach decision makers. This suggests that much data is still batch-loaded overnight.

Posted October 09, 2012

The opportunities and challenges presented by big data are examined in a new survey of 298 data managers and professionals who are part of the Independent Oracle Users Group. The survey was underwritten by Oracle Corporation and conducted by Unisphere Research, a division of Information Today, Inc. According to this new survey, more than one out of 10 data managers now have in excess of a petabyte of data within their organizations, and a majority of respondents report their levels of unstructured data are growing. Fewer than one out of five respondents feel their IT infrastructure will be ready to handle this incoming surge of data. Protecting data overall is important, but unstructured data gets low priority at this time.

Posted September 26, 2012

Data management vendor Terracotta, Inc. has released BigMemory Go, the latest innovation in the BigMemory line that allows customers to put as much data in memory as desired to speed application performance at big data scale. The product is being offered via a free 32GB per instance production license that can be deployed on as many servers as desired.

Posted September 25, 2012

Infobright has introduced a database appliance purpose-built for the analysis of machine-generated data called Infopliance. Integrating Infobright's analytic database with dedicated server and storage hardware, the new appliance is intended to provide customers with a cost-effective, scalable solution for extracting insight from growing volumes of real-time and historical information generated by web logs, network logs, call detail records, security data, and sensor data. "We have seen a growing need among customers who are going from one terabytes to two terabytes, to 15 terabytes, to 30 terabytes. They are experiencing very explosive data growth, and we began to realize that there would be a market for delivering a purpose-built machine-generated data appliance," Don DeLoach, president and CEO of Infobright, tells 5 Minute Briefing.

Posted September 24, 2012

The first computer program I ever wrote (in 1979, if you must know) was in the statistical package SPSS (Statistical Package for the Social Sciences), and the second computer platform I used was SAS (Statistical Analysis System). Both of these systems are still around today—SPSS was acquired by IBM as part of its BI portfolio, and SAS is now the world's largest privately held software company. The longevity of these platforms—they have essentially outlived almost all contemporary software packages—speaks to the perennial importance of data analysis to computing.

Posted September 19, 2012

In recent years, the networks of developers, integrators, consultants, and manufacturers committed to supporting database systems have morphed from one-on-one partnerships into huge ecosystems in which they have become interdependent on one another, and are subject to cross-winds of trends and shifts that are shaping their networks. Nowhere is this more apparent than the huge ecosystem that has developed around Oracle. With Oracle's never-ending string of acquisitions, new functionality, and widespread adoption by enterprises, trends that shape this ecosystem are certain to have far-reaching effects on the rest of the IT world. Concerns that percolate through the ecosystem reflect — and influence — broad business concerns. New paradigms — from cloud computing to big data to competing on analytics — are taking root within the Oracle ecosystem long before anywhere else.

Posted September 19, 2012

Big data is toughfor enterprises to handle, and adding to the challenge is the fact that much of it is unstructured data—business documents, presentations, log files, and social media data. Respondents to a survey of 264 data managers and professionals—subscribers to Database Trends and Applications—almost unanimously agree that unstructured data is on the rise and ready to engulf their current data management systems. The trouble is, their management typically does not understand the scope of the challenge and is failing to recognize the significance of unstructured data assets to the business.

Posted September 12, 2012

A new conference called Big Data Insights: Finance is being launched this year, December 4-5, at the Hilton Stamford in Connecticut. According to conference organizers, financial services firms have been collecting, collating and harvesting data for years, and this conference is intended to help them find the right technologies to take advantage of those rich data assets. Banking has long been in data warehousing, but there are new opportunities that are bubbling up in terms of analysis of data, Diana Middleton, conference director, Finance & Investments, Institute for International Research, tells 5 Minute Briefing. "We are really hoping to create a forum where the business side of the house and the technology side of the house can get together and determine how best to use data, be strategic with it, and be able to generate revenue."

Posted September 07, 2012

SAP AG introduced a new solution to help organizations gain real-time insights into market trends and customer sentiment. The SAP rapid-deployment solution for sentiment intelligence with SAP HANA is intended to allow users to analyze customer sentiment from social networking sites, communities, wikis, blogs and other sources, and combine the information with CRM data. Customers that have had success getting started with big data analytics are the ones that have set out to solve a very specific use case or set out to solve a specific problem, David Jonker, director of marketing for database and technology at SAP, tells DBTA. "The rapid deployment solution for sentiment intelligence does exactly that."

Posted August 23, 2012

Pentaho's Business Analytics 4.5 is now certified on Cloudera's latest releases, Cloudera Enterprise 4.0 and CDH4. Pentaho also announced that its visual design studio capabilities have been extended to the Sqoop and Oozie components of Hadoop. "Hadoop is a very broad ecosystem. It is not a single project," Ian Fyfe, chief technology evangelist at Pentaho, tells DBTA. "Sqoop and Oozie are shipped as part of Cloudera's distribution so that is an important part of our support for Cloudera as well - providing that visual support which nobody else in the market does today."

Posted August 23, 2012

Symantec Corp. has partnered with Hortonworks to introduce the new Symantec Enterprise Solution for Hadoop, providing a scalable, resilient data management solution for handling big data workloads. The add-on solution for Symantec's Cluster File System enables Symantec customers to run big data analytics on their existing storage infrastructure.

Posted August 14, 2012

Data warehousing is undergoing the most radical transformation seen since it was first conceived in the 1970s, and brought to market in the late 1980s and 1990s. One reason for this transformation is that data warehouses are on the front lines of the big data explosion. Findings from a new survey of IOUG members indicate that while most companies have well-established data warehouse systems, adoption is still limited within their organizations. This survey, underwritten by Oracle Corporation and conducted by Unisphere Research, a division of Information Today, Inc., included input from 421 data managers and professionals.

Posted August 08, 2012

With the rise of big data,the database and data management tools market is in a state of flux, the likes of which have not been seen in this sector before. Companies are now awash in big data, and end users are demanding greater capability and integration to mine and analyze new sources of information. As a result, organizations are supplementing their relational database environments with new platforms and approaches that address the variety and volume of information being handled.

Posted August 07, 2012

Pages
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30

Sponsors