Striim 4.0.4 documentation

Table of Contents

Creating a data validation dashboard

A data validation dashboard gives you a visual representation of data read and written by a Striim application. Supported sources and targets are:

  • Database Reader

  • File Reader

  • HP NonStop SQL/MX Reader

  • Incremental Batch Reader

  • JMS Reader

  • Kafka Reader versions 0.8, 0.9, 0.10, and 0.11

  • MariaDB Reader

  • MySQL Reader

  • Oracle Reader

  • PostgreSQL Reader

  • Salesforce Platform Event Reader

  • Salesforce Reader

  • Spanner Batch Reader

  • ADLS Gen1 Writer

  • ADLS Gen2 Writer

  • Azure Blob Writer

  • Azure Event Hub Writer

  • Azure SQL Data Warehouse Writer

  • BigQuery Writer

  • Cassandra CosmosDB Writer

  • Cassandra Writer

  • Cloudera Hive Writer

  • CosmosDB Writer

  • Database Writer

  • File Writer

  • GCS Writer

  • Google PubSub Writer

  • HBase Writer

  • HDFS Writer

  • Hortonworks Hive Writer

  • Kafka Writer versions 0.8, 0.9, 0.10, and 0.11

  • Kinesis Writer

  • Kudu Writer

  • MapR DB Writer

  • MongoDB Writer

  • S3 Writer

  • Snowflake Writer

  • Spanner Writer

The application may have multiple sources and/or targets so long as they are all of the same type. For example, you could have multiple sources all using DatabaseReader and multiple targets all using KafkaWriter.

To create and view a data validation dashboard:

  1. Undeploy the application.

  2. Open the application in the Flow Designer, select Configuration > App Settings, enable data validation, and click Save.

  3. Deploy and start the application, then select Configuration > View Validation Dashboard.

data_validation_dashboard.png

Hover the mouse pointer over a bar to see additional details for that source or target for the indicated time period. Click Pause to stop updating the dashboard temporarily so you can compare event counts and verify that all source data was written by the target. 

data_validation_2.png

Validation dashboards do not appear on the Dashboard page.