BlueData Software, Inc., which provides the EPIC software platform that allows enterprises to create a public cloud-like experience from their on-premise environments, has announced a technology preview of the Tachyon in-memory distributed storage system as a new option. Together with the company’s existing integration with Apache Spark, BlueData supports big data analytics with real-time capabilities at scale. In addition, this new integration enables Hadoop, Hbase virtual clusters, and other applications provisioned in the BlueData platform, to take advantage of Tachyon’s high performance in-memory data processing.
According to Blue Data, enterprises need to be able to run a wide variety of big data jobs such as trading, fraud detection, cyber security and system monitoring. These high performance applications require the ability to run in real-time and at scale in order to provide true value to the business, but the company contends, existing approaches using Hadoop are inflexible and unable to fully meet the business needs for high speed stream processing. New technologies such as Spark, which offers 100x faster data processing, and Tachyon, which offers 300x higher throughput, will help overcome these challenges, the company says, but incorporating these technologies with existing big data platforms like Hadoop requires point integrations on a cluster-by-cluster basis, which makes it manual and slow.
With this preview, the company says, it is streamlining infrastructure by creating a unified platform that incorporates Tachyon, and allows users to focus on building real-time processing applications rather than manually combining infrastructure components. The BlueData platform also includes high availability, auto tuning of configurations based on cluster size and virtual resources, and compatibility with each of the leading Hadoop distributions
“First generation enterprise data lakes and data hubs showed us the possibilities with batch processing and analytics. With the advent of Spark, the momentum has clearly shifted to in-memory and streaming with emerging use cases around IoT, real-time analytics and high speed machine learning. Tachyon’s appealing architecture has the potential to be a key foundational building block for the next generation logical data lake and key to the adoption and success of in-memory computing,” said Kumar Sreekanti, CEO and co-founder of BlueData. “BlueData is proud to deliver the industry’s first Big Data private cloud with a shared, distributed in-memory Tachyon file system. We look forward to continuing our partnership with Tachyon to deliver on our mission of democratizing big data private clouds.”
For more information, visit www.bluedata.com.