Hadoop Articles
Apache Hadoop has been a great technology for storing large amounts of unstructured data, but to do analysis, users still need to reference data from existing RDBMS based systems. This topic was addressed in "From Oracle to Hadoop: Unlocking Hadoop for Your RDBMS with Apache Sqoop and Other Tools," a session at the Strata + Hadoop World conference, presented by Guy Harrison, executive director of Research and Development at Dell Software, David Robson, principal technologist at Dell Software, and Kathleen Ting, a technical account manager at Cloudera and a co-author of O'Reilly's Apache Sqoop Cookbook.
Posted October 22, 2014
In his presentation at the Strata + Hadoop World conference, titled "Unseating the Giants: How Big Data is Causing Big Problems for Traditional RDBMSs," Monte Zweben, CEO and co-founder of Splice Machine, addressed the topic of scale-up architectures as exemplified by traditional RDBMS technologies versus scale-out architectures, exemplified by SQL on Hadoop, NoSQL and NewSQL solutions.
Posted October 22, 2014
MapR Technologies, one of the top ranked distributors for Hadoop, has announced that MapR-DB is now available for unlimited production use in the freely-downloadable MapR Community Edition. "From a developer standpoint, they can combine the best of Hadoop, which is deep predictive analytics across the data, as well as a NoSQL database for real-time operations," explained Jack Norris, chief marketing officer for MapR Technologies.
Posted October 21, 2014
Companies are facing the "big squeeze" created by IT budgets that are relatively flat, growing by only 3% to 4% a year, versus data growth that is averaging 30% to 40%, and a consensus that data is a valuable commodity that cannot be thrown away, said Monte Zweben, CEO and co-founder of Splice Machine in his presentation at the Strata + Hadoop World conference.
Posted October 21, 2014
Datameer has introduced Datameer 5.0 with Smart Execution, a technology that examines dataset characteristics, analytics tasks and available system resources to determine the most appropriate execution framework for each workload.
Posted October 21, 2014
At Strata + Hadoop World in New York, Microsoft announced an update to Microsoft Azure HDInsight, its cloud-based distribution of Hadoop. Customers can now process millions of Hadoop events in near real time, with Microsoft's preview of support for Apache Storm clusters in Azure HDInsight. In addition, as part of its integration with the Azure platform, Hortonworks announced that the Hortonworks Data Platform (HDP) has achieved Azure Certification.
Posted October 20, 2014
With Cloudera 5.2 the focus is on building products to deliver on the promise of the enterprise data hub that Cloudera introduced last year, said Clarke Patterson, senior director of product marketing at Cloudera. In particular, new capabilities make the technology more accessible to users who are not data scientists and also increase the level of security, two hurdles which can stand in the way of Hadoop adoption.
Posted October 15, 2014
The new Dell In-Memory Appliance for Cloudera Enterprise is designed to provide customers with a processing engine combined with interactive analytics in a preconfigured and scalable solution, and will begin shipping Oct. 15, 2014.
Posted October 14, 2014
Dataguise, a provider of security and data governance solutions for big data, has expanded its DgSecure platform to support Hadoop in the cloud, including full support for Amazon EMR (Elastic MapReduce). Additionally, big data cloud service providers, Altiscale and Qubole, have joined Dataguise's Big Data Protection Partner Program (BDP3) to leverage DgSecure in providing comprehensive discovery, protection and visibility to sensitive data for their cloud-based Hadoop customers.
Posted October 13, 2014
Splunk, which provides software for machine-generated big data analysis, has announced Splunk Enterprise 6.2, Splunk Mint, and Splunk Hunk 6.2. "What we are doing with this release is fundamentally broadening the number of users that can do advanced analytics," stated Shay Mowlem, VP, product marketing at Splunk.
Posted October 13, 2014
IBM is adding new analytics capabilities to the mainframe platform, helping enable better data security and providing clients with the ability to integrate Hadoop big data. By applying analytic tools to business transactions as they are occurring, mainframe systems can enable clients to have true real-time insights. With the analytics on the System z platform, clients can also incorporate social media into their real-time analytic.
Posted October 13, 2014
Teradata is introducing Teradata Loom 2.3, a platform that provides integrated metadata management, data lineage, and ata wrangling for enterprise Hadoop. Teradata has also launched Teradata Cloud for Hadoop, a turnkey, full service cloud environment, and a broad technology and marketing partnership with Cloudera. "Increasingly, customers want a one-stop shop for their data analytics needs," said Chris Twogood, vice president of products and services at Teradata.
Posted October 09, 2014
One feature of the big data revolution is the acknowledgement that a single database management system architecture cannot meet all needs. However, the Lambda Architecture provides a useful pattern for combining multiple big data technologies to achieve multiple enterprise objectives. First proposed by Nathan Marz, it attempts to provide a combination of technologies that together can provide the characteristics of a web-scale system that can satisfy requirements for availability, maintainability, and fault-tolerance.
Posted October 08, 2014
Big analytics and visualization company Datameer is releasing version 5.0 of the company's data analytics application for Hadoop. "Our vision overall is to make data simple and accessible for everyone," said Matt Schumpert, director of product management with Datameer, about version 5.0 improvements.
Posted October 01, 2014
To help customers to meet demanding data challenges, Embarcadero Technologies has announced a major new XE6 release of its portfolio of database tools, including ER/Studio, DBArtisan and Rapid SQL.
Posted September 24, 2014
MapR Technologies has introduced the 4.0.1 version of the MapR Distribution including Hadoop. The latest MapR release expands real-time capabilities for use cases including operational applications, interactive queries and stream processing with new versions of Apache Drill, Apache Spark, and Apache HBase, while leveraging Hadoop 2.4, including YARN.
Posted September 23, 2014
Broadening the range of tools at its disposal to help customers who are grappling with emerging technologies for leveraging unstructured data, Teradata this week announced its acquisition of Think Big Analytics, a consulting and solutions company that is focused exclusively on Hadoop and open source big data solutions.
Posted September 04, 2014
To help companies evaluate big data systems, a new benchmark has been launched by the Transaction Processing Performance Council (TPC). TPCx-HS is a major achievement for two reasons, noted Raghunath Nambiar, chairman of the TPCx-HS committee, and a distinguished engineer at Cisco. It is the first vendor-neutral benchmark focused on big data systems - which have become a critical part of the enterprise IT ecosystem. TPCx-HS is also the first Express-class benchmark issued by the TPC.
Posted September 03, 2014
Why do tens of thousands of Oracle customers, partners, and consultants descend on Moscone Center in San Francisco for the annual Oracle OpenWorld conference? Despite the proliferation of conferences and online events competing for attention, OpenWorld remains the single, central place for all things Oracle. Here, DBTA presents the annual Who to See @ Oracle OpenWorld special section.
Posted August 27, 2014
2014 is turning out to be a banner year for Hadoop. The big data giant is continuing to move forward and expand and evolve as big data technology and big data analytics become more mainstream. Here are six key points that demonstrate the advances being made.
Posted August 19, 2014
At the summer 2014 SHARE conference in Pittsburgh, Brian Peterson, who has been president of SHARE for the past two years, spoke about the challenges facing companies today as they deal with emerging IT requirements and the successful approaches for dealing with the mainframe skills shortage. With SHARE's 60th anniversary coming up, Peterson also reflected on the role SHARE has played in the world economy by supporting technology that is critical to industries such as banking, transportation, and manufacturing.
Posted August 18, 2014
Splice Machine, a provider of a Hadoop RDBMS, has added a $3 million extension to its Series B financing provided by venture capital firm Correlation Ventures, along with database industry leaders Roger J. Sippl and Roger Bamford. The new funding adds to the initial $15 million Series B investment from Interwest Partners and Mohr Davidow Ventures (MDV), bringing the total round to $18 million.
Posted August 12, 2014
Actian has started the Big Data 2.0 Clear Path Program to help companies jumpstart analytics projects and move existing ones into production more rapidly. Developed by data scientists in Actian's Analytics Center of Excellence (COE), the Big Data 2.0 Clear Path Program applies big data concepts for faster time to value, higher accuracy and deeper discovery, leveraging the Actian Analytics Platform.
Posted August 05, 2014
X15 Enterprise, which provides an end-to-end solution for ingesting, indexing, searching and analyzing machine data, is now generally available from X15 Software. According to the vendor, X15 Enterprise allows machine data to remain in HDFS and does not require it to be duplicated into proprietary storage before it can be indexed and analyzed.
Posted August 05, 2014
The converging forces of open source, with its rapid crowd-sourced innovation, cloud, with its unlimited capacity and on-demand deployment options, and NoSQL database technologies, with their ability to handle unstructured data, are helping companies address the new challenges and opportunities presented by big data. Here are the winners of the 2014 DBTA Readers' Choice Awards for Best Big Data Solution.
Posted August 04, 2014
Novetta Identity Analytics has achieved Hortonworks Certification, and Novetta has joined the Hortonworks Technology Partner Program. Novetta Identity Analytics provides a central, multi-dimensional view of the entities across the data silos and uncovers the relationships within and among those entities to support customer intimacy, churn prediction, risk profiling, fraud analysis and detection, and other use cases.
Posted August 04, 2014
Tata Consultancy Services (TCS), an IT services, consulting and business solutions organization, has formed a new partnership with MapR Technologies. The two companies are developing turn-key solutions to address big data challenges.
Posted July 29, 2014
Databricks and SAP have collaborated on a Databricks-certified Apache Spark distribution offering for the SAP HANA platform. This production-ready distribution offering is the first result of a new partnership between Databricks and SAP.
Posted July 23, 2014
In "Big Data at Work," Tom Davenport explains to readers why big data is important to them and their organizations, what technology they actually need to manage it, and where to start capitalizing on its potential. Here, the author shares an excerpt from his recent book.
Posted July 23, 2014
Helping companies get more from big, unstructured data, Actian has unveiled the Actian Analytics Platform - Hadoop SQL Edition. In addition, as a result of a partnership with Logi Analytics, the Actian Analytics Platform combines with Logi Info to offer customers a comprehensive analytics platform to connect, visualize, analyze and act on big data.
Posted July 22, 2014
InfiniDB has released version 4.6 of its fourth generation columnar data platform, which includes enhanced support for large-scale join operations and support for additional data load commands to speed the extraction, transformation, and load (ETL) process. The company also introduced a new 60-day enterprise trial that includes InfiniDB Enterprise Manager, a management console to simplify the administration of InfiniDB, and provide real-time visibility into the performance and availability of users' InfiniDB servers.
Posted July 15, 2014
Oracle today introduced Oracle Big Data SQL, which allows customers to run one SQL query across Hadoop, NoSQL, and Oracle Database, minimizing data movement while overcoming data silos. According to Oracle the new solution helps customers gain a competitive advantage by making it easier to uncover insights faster, and allows them to leverage existing SQL skills while protecting data security and enforcing governance. Oracle Big Data SQL runs on Oracle Big Data Appliance and can work in conjunction with Oracle Exadata Database Machine.
Posted July 15, 2014
As part of a collaboration to make Apache Hadoop and Spark accessible for everyday analysts, Alteryx and Databricks will become the primary committers to SparkR, a subset of the overall Apache Spark framework. In addition, Alteryx and Databricks are forming a technology and go-to-market partnership to accelerate the adoption of SparkR and SparkSQL, in order to help analysts get greater value from Spark as the leading open source in-memory engine.
Posted July 08, 2014
Data Lake Hadoop, a new bundle from Pivotal and EMC, combines scale-out enterprise storage and big data and analytics to offer a production-grade HDFS solution. The bundle consists of pre-configured EMC Isilon X410 nodes, HAWQ subscriptions and Pivotal HD, Pivotal's enterprise version of Apache Hadoop.
Posted July 08, 2014
Following a recently announced a partnership with Databricks, DataStax has integrated Spark for real-time analytics into DataStax Enterprise. In addition, the 4.5 release adds the ability to merge Cassandra data with Hadoop for integration of operational and historical data. The new release has been certified with Hadoop vendors Cloudera and Hortonworks and DSE has been certified for their platforms.
Posted July 01, 2014
Pentaho has announced version 5.1 of its business analytics and data integration platform. The new release enables code-free analytics directly on the NoSQL database MongoDB, simplifies the data preparation process for data scientists, and offers full support for MapReduce 2.0 (YARN).
Posted June 24, 2014
Data security specialist Dataguise has introduced Dataguise for Data Governance suite, a solution suite for big data governance that will initially support Oracle, IBM DB2, SQL Server, Teradata, Cloudera, Hortonworks, MapR and Pivotal HD.
Posted June 20, 2014
Big data analytics hold great promise, but the present methods of mining and managing big data are still evolving and pose serious security and privacy challenges. Confronting these challenges is essential if the potential of big data is to be fully exploited.
Posted June 17, 2014
The database market is heating up again. Recent venture funding and acquisition announcements from key Hadoop and NoSQL startups are drawing attention to the big data space.
Posted June 17, 2014
Today, many businesses are looking for ways to rationalize their mainframe capacity in order to contain MIPS growth as well as defer costly upgrades. Unfortunately, some of these stopgap measures involve costly trade-offs, such as keeping only the most recent or even archiving critical data to tape. This can mean that valuable information goes untapped.
Posted June 11, 2014