Hazelcast IMDG Updates Legacy Architectures with Digital Integration Hubs

Hazelcast, a leading open source in-memory computing platform, is introducing a new major feature and a number of enhancements to its in-memory data grid (IMDG), Hazelcast IMDG.

Among the updates are preview support for managing distributed data using SQL, out-of-the-box support for Kerberos, additional tuning options for Intel Optane DC Persistent Memory Modules, and quicker cluster rebalancing.

According to the vendor, with the latest version of Hazelcast IMDG, use cases such as digital integration hubs gain improved performance, scalability, and resiliency.

Hazelcast empowers proven, in-memory digital integration hubs by providing object storage in RAM, write-through caching, distributed processing, and predefined connectors to many popular data sources.

"Evolving legacy architectures, especially those with heterogeneous backends, toward new data channels pose a technological challenge of how to put all the pieces together while keeping the overall complexity maintainable. Digital integration hubs provide a central access point to those backend data sources that multiple applications can call upon uniformly," said Kelly Herrell, CEO of Hazelcast. "Given that the hubs are the central component of these architectures, it needs to be fast, scalable, reliable, and secure. The Hazelcast In-Memory Computing Platform provides the necessary capabilities that not only fulfill the requirements of the largest enterprises, but significantly simplifies the deployment and operational experiences when working with these innovative new digital integration hub architectures."

To complement the existing APIs for languages including Java, .NET, Node.js, Python, C++ and Go, Hazelcast IMDG is introducing SQL support.

Adding this capability to Hazelcast IMDG enables digital integration hubs to retrieve data using a common well-known API. Usage of indexes to speed up the queries, along with the ability to filter results on attributes extends Hazelcast IMDG beyond the limited query-by-key capability of basic key-value stores. The familiarity equates to simplified development and reduced implementation costs as well.

In this release, the SQL support is intended for "select" queries on Hazelcast IMDG maps already populated with data. Additional capabilities, such as joins, aggregations and sorting will be added in future releases.

Since a digital integration hub is the primary access point for business-critical applications, any downtime can carry significant penalties, including potentially lost revenue and/or customers. Should a hardware failure occur, such as a computer crash, the cluster must restore the lost data immediately by promoting the backups of the lost partitions.

 However, the restoration process still requires the rebalancing of partitions across the cluster. In this release, Hazelcast is introducing parallel partition migrations which accelerates cluster rebalancing and reduces the time spent in a suboptimal state by an order of magnitude. As an example, should a network disconnect one node in a 10-node cluster responsible for storing four terabytes of data, Hazelcast IMDG will be able to complete partition rebalancing in approximately 2 minutes when it would have previously required at least 33 minutes.

To further reduce the possibility of downtime, Hazelcast IMDG improves its partial network failure detection capabilities utilizing the implementation of the Bron–Kerbosch algorithm. This enhancement translates to improved high-availability in scenarios where a Hazelcast IMDG cluster must recover from hard-to-detect network failure scenarios.

Hazelcast is introducing first-class, out-of-the-box support for Kerberos, a widely used authentication protocol. By integrating Kerberos support into Hazelcast IMDG, the engineering time and risks associated with manual integration are greatly reduced. The Kerberos protocol complements the enterprise-grade security suite of Hazelcast IMDG Enterprise.

Through the on-going co-engineering activities with Intel, Hazelcast continues to optimize its platform to take full advantage of Intel Optane DC Persistent Memory Modules. This release features the ability to use all Intel Optane Persistent Memory Modules installed in a system resulting in the ability for enterprises to build cost-efficient, terabyte-sized in-memory deployments.

In addition, Hazelcast added performance tuning options that can increase the throughput of the system by 50% to gain near RAM-like speeds for half the cost in select use cases.

For more information about these updates, visit