The Power of Change Data Capture

Break free from batch operations with a modern ETL that replicates data the moment it changes.

Why is CDC better than traditional ETL?
  • Change data moves continuously as new database transactions occur, enabling you to respond to time-sensitive issues immediately.
  • CDC minimizes overhead on source systems, extends hardware lifetime, and circumvents batch window limitations.
  • Moving only change data continuously throughout the day saves bandwidth and drives communications cost savings.
  • When applying changes to target databases or data warehouses, the ordering and transactionality of those changes remains intact.
Change data capabilities on Striim

Striim uses log-based change data capture when ingesting from major enterprise databases including Oracle, SQLServer HPE NonStop, MySQL, PostgreSQL, MongoDB, among others. It minimizes CPU overhead on sources, does not require application changes, and substantial management overhead to maintain the solution.

Heterogeneous integration

Striim’s real-time data ingestion is not limited to databases and the CDC method. With Striim you can merge real-time transactional data from OLTP systems with real-time log data, messaging systems, sensor data, NoSQL, and Hadoop data to obtain rich, comprehensive, and reliable information about your business.

Maintain transactional context

When ingesting the change data from database logs, Striim moves committed transactions with the transactional context maintained. Throughout the whole data movement, processing, and delivery steps, this transactional context is preserved so that users can create reliable replica databases.

In-flight transformations

Striim offers out-of-the-box transformers, and in-memory stream processing capabilities to filter, aggregate, mask, transform, and enrich change data while in motion. Using SQL-based continuous queries, Striim immediately turns change data into a consumable format for end users, without losing transactional context.

Mission-critical reliability

As the data moves and gets processed through the in-memory components of the Striim platform, every operation is recorded and tracked by the solution. If there is an outage, Striim can replay the transactions from where it was left off — without missing data or having duplicates. Built-in recovery and high-availability using a Striim cluster ensure mission-critical reliability.

Built-in data validation

The platform continuously compares the source and target systems, as the data is moving, validating that the databases are consistent and all changed data has been applied to the target. In use cases, where data loss must be avoided, such as migration to a new cloud data store, this feature immensely minimizes migration risks.

Cloud and on-premise change delivery

With the same software, Striim can deliver change data in real-time not only to on-premise databases but also to databases running in the cloud, cloud services, messaging systems, files, Hadoop, and NoSQL environments. Striim’s integration data flow applications can have multiple targets with concurrent real-time data delivery.

Ready to get started?

Learn more about real-time data integration in a modern data architecture with Striim.