Striim 3.9.6 documentation

Readers overview

The following is a summary of reader capabilities.

reader

input(s)

output stream type(s)

supports replication

recoverable

Database Reader

JDBC

WAEvent

insert only

if output is persisted to a Kafka stream (or use Incremental Batch Reader instead)

File Reader

Apache access log, Avro, binary, delimited text, free-form text (using RegEx), GoldenGate trail file, JSON, name-value pairs, XML

WAEvent, AvroEvent (when input is Avro), or user-defined JSON (when input is JSON)

for GoldenGate only

yes

HDFS Reader

Apache access log, binary, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent or user-defined JSON (when input is JSON)

no

yes

HP NonStop Enscribe, SQL/MP, and SQL/MX Readers

NonStop TMF audit trail

WAEvent

yes

yes

HTTP Reader

Apache access log, binary, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent or user-defined JSON (when input is JSON)

no

if output is persisted to a Kafka stream

Incremental Batch Reader

JDBC

WAEvent

insert only

yes

JMS Reader

Apache access log, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent or user-defined JSON (when input is JSON)

no

yes

JMX Reader

Java Management Extensions (JMX)

JSONNodeEvent

no

yes

Kafka Reader

Apache access log, Avro, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent, AvroEvent (when input is Avro), or user-defined JSON (when input is JSON)

no

yes

MapR FS Reader

Apache access log, binary, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent or user-defined JSON (when input is JSON)

no

yes

MongoDB Reader

MongoDB replica set operations log (oplog.rs)

JSONNodeEvent

yes

yes

MQTT Reader

Avro, delimited text, JSON, name-value pairs, XML

WAEvent, AvroEvent (when input is Avro), or user-defined JSON (when input is JSON)

no

yes

MS SQL Reader

SQL Server transaction log

WAEvent

yes

yes

MultiFile Reader

Apache access log, Avro, binary, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent, AvroEvent (when input is Avro), or user-defined JSON (when input is JSON)

no

if output is persisted to a Kafka stream

MySQL Reader

MySQL binary log (binlog)

WAEvent

yes

yes

OPCUA Reader

an OPC-UA server

OPCUADataChangeEvent

no

yes

Oracle Reader

LogMiner or XStream Out

WAEvent

yes

yes

PostgreSQL Reader

PostgreSQL logical replication slot

WAEvent

yes

yes

Salesforce Reader

Force.com REST API

WAEvent

yes

yes

Salesforce Platform Event Reader

Salesforce platform event message subscription

WAEvent

insert only

yes

Salesforce Push Topic Reader

Salesforce Streaming API

WAEvent

yes

yes

S3 Reader

Apache access log, Avro, binary, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent, AvroEvent (when input is Avro), or user-defined JSON (when input is JSON)

no

yes

TCP Reader

Apache access log, binary, delimited text, free-form text (using RegEx), JSON, name-value pairs, XML

WAEvent or user-defined JSON (when input is JSON)

no

if output is persisted to a Kafka stream

UDP Reader

Apache access log, binary, collectd, delimited text, free-form text (using RegEx), JSON, Kafka stream, name-value pairs, NetFlow v5 or v9, SNMP, XML

WAEvent, CollectdEvent (when input is collectd), or user-defined JSON (when input is JSON)

no

if output is persisted to a Kafka stream

Windows Event Log Reader

Windows Application, Security, or System event log

WindowsLogEvent

no

yes

For more information, see: