New MapR Ecosystem Pack Optimizes Security and Performance for Apache Spark

MapR Technologies has released an updated version of the MapR Ecosystem Pack (MEP) program, a set of open source ecosystem projects that support applications running on the MapR Converged Data Platform with inter-project compatibility.

Version 3.0 of MEP adds improved security for Spark, new Spark connectors for MapR-DB and HBase, updates and integrations with Drill, and a faster version of Hive.

“The adoption of Spark and Drill continues to advance at a fast pace with enterprises worldwide,” said Will Ochandarena, senior director, product management, MapR Technologies. “With a regular cadence of ecosystem updates that make it easier to adopt for production use, our customers immediately benefit from rapid open source innovation with the reliability, scale and performance of the Converged Data Platform.”

According to MapR, its Ecosystem Pack alleviates the complexity of coordinating t community projects and versions. MapR develops, tests, and integrates open source ecosystem projects such as Apache Drill, Spark, Hive, and Myriad, among others.

The new MapR Ecosystem Pack version 3.0 includes Apache Spark 2.1.0, a release that focuses on improvements in enterprise-ready stability and security; a native Spark connector for MapR-DB JSON that makes it easier to build real-time or batch pipelines between data and MapR-DB while leveraging Spark or Spark Streaming within the pipeline; a Spark-HBase and MapR-DB Binary Connector, providing the ability to write applications that consume HBase binary tables and use them in Spark; Apache Drill 1.10, which provides updates around BI tool integration, end to end security, performance, and usability; and a faster version of Hive to improve the speed for data processing tasks, provide smaller latency for interactive queries, and higher throughput for batch queries.

In addition, with MapR core Release 5.2.1, userscan develop C applications for MapR Streams. The MapR Streams C Client is a distribution of librdkafka that integrates with MapR Streams. With MapR core Release 5.2.1, developers can create Python applications for MapR Streams using the MapR Streams Python client. The Streams Python client is a binding for librdkafka and contains support for high-level consumers.

The MapR Ecosystem Pack version 3.0 is available now. For additional details, go here.