Streaming Data Integration
August 29, 2023
Why Choose Striim vs. Attunity (Qlik Replicate)?
- Modern, cloud-scale architecture
- Under 2 seconds end-to-end latency
- Transform, enrich, and analyze your data on the fly
Fortune 500 companies power their cloud initiatives with Striim
Companies Choose Striim for Scalable, Real-Time Replication
“Our legacy analytics platform used to take an hour per customer data load and weeks for each new deployment. With Striim we are able to transfer operational data to Snowflake in near realtime.”
Prashant Soral,
CTO at Inspyrus
“We chose Striim as it provides continuous access to the data in our MySQL database without impacting its performance, and without taking the data out of the Google Cloud environment.”
Paolo Giangiacomo,
Systems Integration Manager, HomeServe
Striim vs. Qlik Replicate: Feature Comparison
Cloud-Scale Architecture
Striim scales horizontally on in-memory compute with high availability and failover for maximum uptime.
Qlik Replicate is a single-node solution. Doesn’t scale horizontally. Must be deployed as a virtual machine. Can deploy in a server cluster to run separate data pipelines but a single pipeline can’t scale across nodes.
Striim
Qlik
Real-time Transformations + Analysis
Striim users can build detailed in-flight transformations, data masking, filtering logic using high-speed SQL queries. Striim scales horizontally with in-memory compute for high performance transformations.
Qlik Replicate supports a limited set of pre-defined transformations and basic filters. Qlik doesn’t scale on in-memory compute, therefore scalable in-flight transformations and data processing/analysis aren’t possible.
Striim
Qlik
Real-Time Data Visualization Dashboards
Striim offers real-time dashboards visualizing end-to-end data delivery from source to target. Striim matches source and target transactions and alerts users to missing transactions, making it easy to catch issues as they happen.
Striim offers data delivery SLAs and customers see end-to-end latency under 2 seconds.
Qlik Replicate provides a graphical overview of replication tasks, but only provides the table name, number of records loaded, and time when error occurred. This makes it difficult to debug data lag and data loss scenarios.
Striim
Qlik
Real-Time Data Enrichment
Striim supports data enrichment and normalization using in-memory key-value stores for historic data. This allows you to enrich raw, real-time data with historical aggregates and lookup data.
Qlik Replicate doesn’t support data enrichment.
Striim
Qlik
Cloud Partnerships
Striim’s cloud partners include Google, Microsoft, AWS, and Snowflake. Striim partners closely with cloud vendors to support a full breadth of endpoints for a variety of strategic use cases. Striim also supports deployment via metered and SaaS marketplace offerings to take advantage of cloud scalability.
Qlik partners with cloud vendors including Google, Microsoft, and Snowflake, but its solution is not built to take advantage of the scalability of the cloud. Offers limited technical integration with cloud partners.
Striim
Qlik
Custom Alerts
Striim allows custom alerts on data delivery SLAs, data loss, and user-defined rules.
Qlik Replicate allows configuration of a limited set of predefined alerts.
Striim
Qlik
Data Sources: Cloud and On-Premise
Databases and Data Warehouses
Striim
Qlik
Data Sources: IoT Devices
Striim
Qlik
Data Sources: Kafka
Striim
Qlik
Data Targets: Cloud Data Warehouses
and Databases
Striim
Qlik
Data Targets: Messaging Systems
Striim offers Kafka, JMS, AMPQ, and MapR Streams as targets.
Qlik Replicate offers Kafka and MapR streams as targets.
Striim
Qlik
Data Targets: APIs
Striim
Qlik
High-Performance, E1P CDC
Striim supports high-performance, E1P log-based CDC for many popular databases including: Oracle, PostgreSQL, MongoDB, MySQL, HPE Nonstop, and SQL Server.
Qlik Replicate also offers high-performance CDC from popular databases.
Striim
Qlik
Striim offers a modern data platform that's both powerful and easy to use
Create data flows with a few clicks
Select from hundreds of templates to simplify building your data flows. A step-by-step wizard will lead you through the process of connecting to your source and target to create a data flow application. You can also create custom data flows from scratch.
Process your data with real-time SQL queries
Your data flow defines how to collect, process, and deliver data. The simplest data flow just has a source, a stream, and a target. In many cases you will need to perform some processing on your data. Striim enables you to set up continuous SQL queries optimized for streaming, real-time data.
Monitor your data flow in real-time
Our built-in dashboards and monitoring enable you to see the state of your data flows in real-time and easily identify any bottlenecks. Striim can also validate that your data has been delivered and provide visibility into the end-to-end lag. This level of visibility is essential for mission-critical systems that may have SLAs regarding how current the data is.
You can also drill down on any of the components in a data flow to see detailed statistics that include read/write rate, lag, latency, CPU usage, and many other metrics. This detailed information can help identify any bottlenecks, and aids in tuning data flows for maximum performance and minimal latency.
Set alerts and create workflows to take corrective action
Striim allows you to define SQL-based custom alerts so you can stay informed about the status and performance of your data flows.
In the case of errors, or failures, you can also automate workflows to perform corrective actions. By tapping into error or status streams you can trigger compensating data flows to start, or perform other actions to remediate problems.
” Striim gives us a single source of truth across domains and speeds our time to market delivering a cohesive experience across different systems. “
Neel Chinta, IT Manager at Macy’s
Sources
Microsoft SQL Server
MongoDB
MySQL
Oracle
PostgreSQL
Salesforce
Targets
Azure Synapse Analytics
Databricks
Google BigQuery
Kafka
PostgreSQL
Snowflake
Helpful how-to guides
We've prepared a few articles to help you get started
August 26, 2023
