Oracle Database initial load
You can use Database Reader for initial load to create a point-in-time copy of your existing source Oracle dataset at the target. This establishes a baseline for subsequent continuous updates. You can deploy Database Reader with Oracle versions 11g, 12c, 18c, 19c, and 21c across various deployment scenarios, including on-premises Oracle and Amazon RDS for Oracle..
Database Reader works seamlessly with Oracle RAC and PDB/CDB configurations, giving you flexibility for complex enterprise database architectures. You can leverage Database Reader's parallel processing capabilities to accelerate data loading for large datasets, while the system automatically handles schema creation and data type mapping between Oracle and target systems. You can configure table selection with wildcard support, create custom SQL queries for selective data extraction, optimize batch sizes for performance tuning, and establish SSL/TLS connectivity for secure connections.
If not using an automatic pipeline wizard, before running the initial load application, see Switching from initial load to continuous replication of Oracle Database sources.
Note
To read from tables in both Oracle CDB and PDB databases, you must create two instances of DatabaseReader, one for each.
Oracle Database setup for initial load
In Oracle, create a user for use by Striim with SELECT privileges on the tables to be read and on the DBA_TAB_COLS and ALL_COLL_TYPES tables.
Database Reader properties for Oracle Database sources
property | type | default value | notes |
|---|---|---|---|
Connection Profile Name | enum | Not applicable to Oracle Database sources in this release. | |
Connection URL | String | When connecting through an SSH tunnel (see Using an SSH tunnel to connect to a source or target), specify the IP address of the tunnel. Specify For RAC or PDB environments, use the service name, not the SID. For Oracle Cloud DBaaS, use To use Oracle native network encryption, append If one or more source tables contain LONG or LONG RAW columns, append If appending more than one element, begin all but the first with | |
Create Schema | Boolean | False | If set to True, when Database Reader's output stream is the input stream of an Azure Synapse Writer, BigQuery Writer, Database Writer (for MariaDB, MariaDB Xpand, MySQL, Oracle, PostgreSQL, SQL Server, or YugabyteDB only), Databricks Writer, Fabric Data Warehouse Writer, Fabric Mirror Writer, Iceberg Writer, Snowflake Writer, or Spanner Writer target, the schema(s) and tables specified in the Tables property in the writer will be created in the target. For example, if the Tables property in the writer is Data types will be mapped as per Target data type support & mapping for Oracle sources. Single-column PRIMARY KEY constraints will be replicated in the target. DEFAULT, FOREIGN KEY, NOT NULL, composite PRIMARY KEY, and UNIQUE KEY constraints will not be replicated. If a table already exists in the target, Striim will verify that the source and target structure match. If they do not, the application will halt and log a TargetTableSchemaMismatchException. MON output for the target tables will include a schemaCreationStatus of Pending, InProgress, Success, or Failed. |
Database Provider Type | String | Default | Set to Oracle. Controls which icon appears in the Flow Designer. |
Excluded Tables | String | Data for any tables specified here will not be returned. For example, if | |
Fetch Size | Integer | 100 | Sets the maximum number of records to be fetched from the database in a single JDBC method execution (see the discussion of fetchsize in the documentation for your JDBC driver). |
JAAS Configuration | String | This is not supported in Striim Cloud. | |
Password | encrypted password | The password for the specified user. See Encrypted passwords. | |
Parallel Threads | Integer | 1 | For Fast Snapshot Loading to Azure Synapse, BiqQuery, Databricks, Fabric Data Warehouse, Microsoft Dataverse, or Snowflake, specify the number of threads Database Reader will use. This value should not be higher than the number of tables to be read. For other targets, leave set to the default of 1. When Database Reader is started, the tables will be distributed among the threads in round-robin fashion, then each thread will read one table at a time. When the Tables property is a list of tables, the tables are read in that order. If the Tables property uses a wildcard, the sequence is determined by the order in which the JDBC driver gives Database Reader the list of tables. Known issue DEV-49013: the maximum number of tables supported by Parallel Threads is 255. |
Query | String | Optionally, specify a single SQL SELECT statement specifying the data to return. You may query tables, aliases, synonyms, and views. Query is not supported when Create Schema is True, Parallel Threads is greater than 1, or Restart Behavior on IL Interruption is Truncate_target_table or Replace_target_table. When If the query includes a synonym containing a period, it must be enclosed in escaped quotes. For example: If using a query when the output of a DatabaseReader source is the input of a DatabaseWriter target, specify the target table name as the value of DatabaseReader's Tables field. | |
Quiesce on IL Completion | Boolean | False | |
Restart Behavior on IL Interruption | Enum | Keep target table data | |
Return DateTime As | String | Joda | Set to Set to |
SSL Config | String | If using SSL/TLS, specify the required properties (see the notes on SSL Config in Oracle Reader properties). | |
Tables | String | Specify the table(s) or view(s) to be read. Names are case-sensitive, Specify names as You may specify multiple tables and views as a list separated by semicolons or with the If you are using the Query property, specify QUERY as the table name. Modifying this property can interfere with recovery. If recovery is enabled for the application and it is necessary to modify the tables list, export the application (see Apps page), drop it, update the exported TQL with the new values, and import it (see Apps page). | |
Use Connection Profile | Boolean | False | Not applicable to Oracle Database sources in this release. |
Username | String | Specify the Oracle user name the adapter will use to log in to the server specified in Connection URL. this user must have must have SELECT privileges on the tables specified in the Tables property and on the DBA_TAB_COLS and ALL_COLL_TYPES tables. | |
Vendor Configuration | Striing | When reading from an Oracle PDB database, specify the PDB container name as follows, replacing {"Database" : { "Oracle" : { "CONTAINER" : "<PDB name>"}}} |
Note
To read from tables in both Oracle CDB and PDB databases, you must create two instances of DatabaseReader, one for each.
Sample Database Reader WAEvent
Database Reader’s output type is WAEvent.
For the following row:
id first_name last_name phone street city state zip_code 1 Deborah Burks NULL 9273 Thorne AV Orchard Park NY 14127
The WAEvent would be similar to:
WAEvent{
data: [1,"Deborah","Burks",null,"9273 Thorne AV","Orchard Park","NY","14127"]
metadata: {"TableName":"BikeStores.sales.customers","ColumnCount":8,
"OperationName":"SELECT","OPERATION_TS":1681412863364}
userdata: null
before: null
dataPresenceBitMap: "fwM="
beforePresenceBitMap: "AAA="
typeUUID: {"uuidstring":"01edda2e-77f7-9b21-83c2-8e859085da65"}
};The operation name for Database Reader WAEvents is always SELECT.
For more information about WAEvent, see WAEvent contents for change data.
Database Reader data type support and correspondence for Oracle sources
JDBC column type | TQL type |
|---|---|
Types.ARRAY | java.lang.String |
Types.BIGINT | java.lang.Long |
Types.BIT | java.lang.Boolean |
Types.CHAR | java.lang.String |
Types.DATE | org.joda.time.LocalDate |
Types.DECIMAL | java.lang.String |
Types.DOUBLE | java.lang.Double |
Types.FLOAT | java.lang.Double |
Types.INTEGER | java.lang.Integer |
Types.NUMERIC | java.lang.String |
Types.REAL | java.lang.Float |
Types.SMALLINT | java.lang.Short |
Types.TIMESTAMP | org.joda.time.DateTime |
Types.TINYINT | java.lang.Short |
Types.VARCHARCHAR | java.lang.String |
other types | java.lang.String |
DatabaseReader can not read Oracle RAW or LONG RAW columns (Oracle Reader can).