There are several solutions used today to make data managed by legacy systems available in real time.
Compared to the others, however, Change Data Capture (CDC) is one of the few that can guarantee low latency and, at the same time, drastically reduce the load borne by the systems that manage the company’s core data.
When data is moved from a relational database to a distributed streaming platform what is gained in terms of throughput and latency is, however, lost in terms of strong consistency.
Not all consumers of this data, however, are able to handle this complexity on their own.
There are many possible solutions that can be adopted to mitigate this problem by preserving the consistency of operations on different layers.