Striim 3.10.3 documentation

Readers overview

The following is a summary of reader capabilities.

reader

input(s)

output stream type(s)

supports replication

recoverable

supports LEE

Database ReaderDatabase Reader

JDBC from a supported DBMS (see Database Reader)Database Reader

WAEvent

insert only

if output is persisted to a Kafka stream (or use Incremental Batch Reader instead)

yes

File Reader

Apache access log, Avro, binary, delimited text, free-form text (using RegEx), GoldenGate trail file, JSON, name-value pairs, XML

WAEvent, AvroEvent (when input is Avro), or user-defined JSON (when input is JSON)

for GoldenGate only

yes

yes

HDFS Reader

Apache access log, binary, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent or user-defined JSON (when input is JSON)

no

yes

yes

HP NonStop Enscribe, SQL/MP, and SQL/MX Readers

NonStop TMF audit trail

WAEvent

yes

yes

yes

HTTP Reader

Apache access log, binary, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent or user-defined JSON (when input is JSON)

no

if output is persisted to a Kafka stream

yes

Incremental Batch ReaderIncremental Batch Reader

JDBC from same sources as Database Reader

WAEvent

insert only

yes

yes

JMS ReaderJMS Reader

Apache access log, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent or user-defined JSON (when input is JSON)

no

yes

yes

JMX Reader

Java Management Extensions (JMX)

JSONNodeEvent

no

yes

yes

Kafka ReaderKafka Reader

Apache access log, Avro, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent, AvroEvent (when input is Avro), or user-defined JSON (when input is JSON)

no

yes

yes

MapR FS Reader

Apache access log, binary, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent or user-defined JSON (when input is JSON)

no

yes

yes

MariaDB

MariaDB Galera Cluster binary log (binlog)

WAEvent

yes

yes

no

MongoDB Reader

MongoDB replica set operations log (oplog.rs)

JSONNodeEvent

yes

yes

yes

MQTT Reader

Avro, delimited text, JSON, name-value pairs, XML

WAEvent, AvroEvent (when input is Avro), or user-defined JSON (when input is JSON)

no

yes

no

MS SQL Reader

SQL Server transaction log

WAEvent

yes

yes

yes

MultiFile Reader

Apache access log, Avro, binary, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent, AvroEvent (when input is Avro), or user-defined JSON (when input is JSON)

no

if output is persisted to a Kafka stream

yes

MySQL

MySQL binary log (binlog)

WAEvent

yes

yes

yes

OPCUA Reader

an OPC-UA server

OPCUA Data Change Event

no

yes

no

Oracle Database

LogMiner or XStream Out

WAEvent

yes

yes

yes

PostgreSQL

PostgreSQL logical replication slot

WAEvent

yes

yes

yes

Salesforce Reader

Force.com REST API

WAEvent

yes

yes

yes

Salesforce Platform Event Reader

Salesforce platform event message subscription

WAEvent

insert only

yes

yes

Salesforce Push Topic Reader

Salesforce Streaming API

WAEvent

yes

yes

yes

S3 Reader

Apache access log, Avro, binary, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent, AvroEvent (when input is Avro), or user-defined JSON (when input is JSON)

no

yes

yes

TCP Reader

Apache access log, binary, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent or user-defined JSON (when input is JSON)

no

if output is persisted to a Kafka stream

yes

UDP Reader

Apache access log, binary, collectd, delimited text, free-form text (using RegEx), JSON, Kafka stream, name-value pairs, NetFlow v5 or v9, SNMP, XML

WAEvent, CollectdEvent (when input is collectd), or user-defined JSON (when input is JSON)

no

if output is persisted to a Kafka stream

yes

Windows Event Log Reader

Windows Application, Security, or System event log

WindowsLogEvent

no

yes

no

For more information, see: