Hazelcast, the leading open source in-memory data grid (IMDG) with hundreds of thousands of installed clusters and over 16 million server starts per month, and Striim, provider of the only end-to-end, real-time data integration and streaming analytics platform, today announced the launch of Hazelcast Striim Hot Cache. This integration enables real-time, push-based propagation of changes from the database to the cache. For organizations that manage high volumes of data, Hazelcast Striim Hot Cache ensures continuous synchronization between the cache and its underlying database, providing consistency with the system of record.
With Hazelcast Striim Hot Cache, companies are able to reduce the latency of propagation of data from a backend database into the Hazelcast cache to milliseconds. This provides organizations with a flexibility to run multiple applications off a single database, keeping Hazelcast cache refreshes up-to-date while adhering to low latency SLAs.
Traditionally, if there is a one-to-one relationship between an application and its underlying database, and no other applications or systems are able to make changes to that database, then the intermediary cache stays in-sync with the database. However, if changes are made to the database directly by other applications, then data held in the cache immediately becomes stale. A common workaround to this problem is “time to live” or TTL. This is when companies purge documents from the database after a period of time. For many this is a “near enough” solution. However, the process lowers cache efficiency and is inadequate for businesses that manage high transaction data or need to maintain high levels of customer experience.
Hazelcast Striim Hot Cache leverages Striim’s Change Data Capture (CDC) functionality to capture changes in the underlying database in real time (within milliseconds), and push just those changes instantly to the cache. Through CDC, Striim is able to recognize which tables and key values have changed. Striim immediately captures these changes with their table and key, and, using the Hazelcast Striim writer, pushes those changes into the cache.
The full data for the change is available to Striim. An Object Relational configuration is provided for each cache, so that the changes can be applied to the domain model in Hazelcast. These changes can be inserts, updates and deletes. During transformation, Striim can also perform data enrichment (joining CDC updates with other data, or performing aggregation and more complex processing) before writing the Object to the cache.
Striim offers a CDC Wizard to speed deployment. Users can quickly configure the capture of change data from a variety of databases (including Oracle, MS SQL Server, MySQL and HPE NonStop), and propagate that data to their Hazelcast cache. No configuration is required in Hazelcast.
“Having a cache that’s out-of-sync with its underlying database can have dramatic consequences for important transactional data, perishable real-time data, or customer experience,” said Ali Kutay, Chairman, President and CEO of Striim. “We are delighted to work with Hazelcast to reduce the latency of their refreshes to milliseconds by integrating our real-time data integration products, including change data capture, with their cache.”
“Caching data in-memory is well proven in speeding up and scaling applications. But holding that extra copy of data creates a synchronization issue,” said Greg Luck, CEO of Hazelcast. “The Hazelcast Striim Hot Cache solves the most difficult form of this problem - the case where other applications are also updating the database being cached. We are very excited to be bringing this critical enterprise solution to market.”