Cloud-First Distributed Architecture for Synchronized Data Integration architecture is based on proven open-source technologies such as Databus – a change data capture system developed and open sourced by LinkedIn. Databus was created to enable a large range of scenarios for synchronization between the source-of-truth databases and applications for external index maintenance, cache invalidation, read scaling, Hadoop ingest and others. Databus has been in production use for many years. has built on that experience and brought significant innovation around selective data synchronization, centralized management, extensibility and cloud support. This paper describes the benefits that brings to synchronized data integration use-cases, a high-level overview of architecture and then a detailed discussion of the architecture.

Download PDF