Striim 3.9.8 documentation

What is change data capture?

Change data capture retrieves changed data from a DBMS or other data store. See the Change data capture Wikipedia article for an overview.

Change data capture using logs

Database management systems originally kept logs of inserted, updated, and deleted data so that changes could be rolled back as necessary to maintain relational integrity. As DBMS technology evolved, additional types of changes were recorded in the logs, Today they may track virtually every action in the system, including transaction start and commit, uncompleted transactions, rollbacks, and changes to table DDL.

DBMS vendors and third parties have found additional uses for these logs. Striim, for example, can extract change data from logs in real time in order to make information available before the DBMS has finished processing it, at the same time minimizing the performance load on the RBMS by eliminating additional queries. There are many potential uses for this information, such raising alerts about error conditions sooner and double-checking DBMS operations in order to identify lost data.

All of the readers discussed in this Change Data Capture Guide capture change data by reading logs.

Change data capture using JDBC

You can use Striim's Incremental Batch Reader to capture change data using JDBC based on timestamps or incrementing values.Incremental Batch Reader