Release notes
The following are the release notes for Striim Platform 5.4.0.4.
Requirements
RHEL versions 7.9 and 9.4 and Ubuntu version 18.04 LTS that were certified for Striim 5.2.0 are not certified for 5.4.x. We strongly recommend that before upgrading to 5.4.0.4 you upgrade to a certified operating system (see System requirements).
Changes that may require modification of your TQL code, workflow, or environment
Starting with release 5.4.0.2, the Oracle Reader property Read Archive Logs Only has been renamed Archive Fence.
Kafka Reader and Kafka Writer versions 0.11 and 2.1.1 are no longer supported. As part of upgrading to Striim 5.4, all Kafka Reader and Kafka Writer adapters in created or quiesced applications will be upgraded to the new versions of the adapters and corresponding connection profiles will be created. If after upgrading you need to import TQL exported from Striim 5.2 or earlier, edit the TQL before importing to use the new properties, and create a connection profile with the appropriate properties. For more information, see Upgrading from Kafka Reader 2.1 or Kafka Writer upgrade guide.
Starting with release 5.4.0.2, the connection profile endpoint type BigQuery Metastore Catalog has been renamed BigLake Metastore Catalog, to reflect the name change by Google. On upgrading, BigQuery Metastore Catalog connection profiles will automatically be converted to BigLake Metastore Catalog connection profiles.
Starting with release 5.2.0, the syntax for defining external sources using the
CREATE EXTERNAL SOURCEstatement has been updated to simplify configuration and support additional source types. For details and updated examples, see CREATE EXTERNAL SOURCE.The event AIData data model for Sentinel was modified in 5.0.6, with the names of two fields updated from 5.0.2. The number of unique sensitive data identifiers is now specified by
numIdentifiers(formerly,Identifiersin 5.0.2), and the number of occurrences of all sensitive data identifiers is now specified bynumOccurrences(formerly,Occurrencesin 5.0.2).Starting with release 5.4.0.2, Striim Platform requires JDK 17. Due to this change, once you upgrade to Striim 5.4.0.2, it will not be possible to downgrade to a previous release.
Before upgrading to Striim Platform 5.4.0.2, you must install JDK 17. See Upgrading to JDK 17.
If you use custom Java functions or open processors, you may need to revise and recompile them to be compatible with with JDK 17. See Updating custom Java functions for JDK 17 or Updating open processors for JDK 17.
If upgrading from Striim 4.x: Due to the switch to JDK 17, when Striim's metadata repository is hosted on Oracle, SSL with a PKCS12 keystore is no longer supported. To use SSL you must migrate to an SSO keystore. See Setting startup properties for the metadata repository ... when hosted on Oracle
Kafka Reader and Kafka Writer versions 0.8, 0.9, and 0.10 are no longer supported. When you upgrade from Striim 4.x to Striim 5.x, any applications using those versions will automatically be updated to use Kafka Reader 2.1 or Kafka Writer 2.1 (which are backward-compatible with the old versions).
As part of upgrading from Striim 4.x to Striim 5.x, a Snowflake Writer with Streaming Upload enabled and Authentication Type set to OAuth or Password will have that property value switched to Key Pair.
Starting with release 4.2.0, TRUNCATE commands are supported by schema evolution (see Handling schema evolution). If you do not want to delete events in the target (for example, because you are writing to a data warehouse in Append Only mode), precede the writer with a CQ with the select statement
SELECT * FROM <input stream name> WHERE META(x, OperationName) != “Truncate”;(replacing<input stream name>with the name of the writer's input stream). Note that there will be no record in the target that the affected events were deleted.OJet requires Oracle Instant Client version 21.6. See Install the Oracle Instant Client in a Striim server or Install the Oracle Instant Client in a Forwarding Agent.
MongoDB Reader no longer supports MongoDB versions prior to 3.6.
MongoDB Reader reads from MongoDB change streams rather than the oplog. Applications created in releases prior to 4.2.0 will continue to read from the oplog after upgrading to 4.2.1. To switch to change streams:
Export the application to a TQL file.
Drop the application.
Revise the TQL as necessary to support new features, for example, changing the Connection URL to read from multiple shards.
Import the TQL to recreate the application.
Databricks Writer's Upload Policy's default eventcount value has been increased from 10000 to 100000 and the Hostname property has been removed since the host name can be retrieved using. the connection URL. (See Databricks Writer properties.)
Customer-reported issues fixed in release 5.4.0.4
DEV-39624: Input Rate / Output Rate shows "N/A" for Database Writer when the Parallel threads property is set greater than 1
DEV-39625: App stuck in stopping status after upgrading
DEV-39626: Database Reader behaves differently after upgrading
DEV-47085: transaction cache should always close the buffer if the app is closed
DEV-50091: Striim agent removed from cluster, cause NOT_ENOUGH_SERVERS
DEV-52101: Oracle Reader issue with SQL parsing
DEV-52219: Oracle Reader old connections are not closed before connection retry
DEV-52293: service offline (ThreadLeak)
DEV-52698: Oracle Reader timestamp precision issue
DEV-52807: OJet - Unable to drop app! No suitable driver found for - with ssl and property variables
DEV-52875: monitoring metrics are frozen in multi-server cluster
DEV-52892: exported TQL with open processor cannot be imported
DEV-52960: ServiceNow Reader failed to send ACL-protected data, leading to an ArrayIndexOutOfBoundsException: null in BigQuery Writer
DEV-53067: Schema Registry SubjectNameMapping is replacing the user supplied character
DEV-53280: For CLOB insert operation, Rollback operation on the Insert events are not filtered
DEV-53297: ServiceNow Reader: logs the exception: java.lang.NumberFormatException: Illegal embedded sign character
DEV-53328: BigQuery Writer "Table Not Found" error
DEV-53330: app is not checkpointing
DEV-53369: Failure to create type using DSVParser MAP feature
DEV-53623: Database Reader with DB2 AS/400 fails post upgrade to 5.2.0: [SQL0204] SYSCOLUMNS in SYSIBM type *FILE not found
DEV-53761: Apps failed with NOT ENOUGH SERVERS
DEV-53812: Initial load app failed with "TABLE_OR_VIEW_ALREADY_EXISTS" - Connection not initialised on restart
DEV-53876: DDLs on uninterested tables should not results in messages in logs and UI
DEV-53894: Databricks Writer - Failed with [TABLE_OR_VIEW_NOT_FOUND] on Staging Table - Problem in Pre-Retry
DEV-54064: App with oracle reader failed: Error : 2008 : Failure in executing queries null
DEV-54064: Oracle Reader Error : 2008 : Failure in executing queries null/li>
DEV-54264: Databricks Writer - stage tables not being dropped
DEV-54297: Oracle Reader > BigQuery Writer with persisted stream: first event not replayed
DEV-54337: View all Apps page takes a long time to load
DEV-54361: Incremental Batch Reader: Excluded Tables not working
DEV-54407: not sending email alerts
DEV-54489: applications stuck in inconsistent state — unable to undeploy or drop app
DEV-54540: BigQuery Writer - high CPU utilization in StopFlow
DEV-54920: Spanner PGDialect Writer overwrites column value on target with NULL
DEV-55018: DESCRIBE USER REST API Call fails with 500 response for specific users
DEV-55020: potential thread leak for USER_NOTIFICATION_QUEUE back-end token
DEV-55035: SalesforceReader: Capture Null values for all columns for all CDC and IL operations by changing SendNullInEvents to true
DEV-55037: Jira reader does not capture data from Votes objects
DEV-55038: BigQuery Writer taking more time to start post upgrade to 5.2.0.4
DEV-55370: Golden Gate (BLOB) > Spanner (BYTEA) Image corruption
DEV-55397: Output metrics are not shown in the UI
DEV-55435: One app hung at stopping state, recreating a new app hung at deploying state
DEV-55464: Striim Cluster Outage Due to High Heap Usage on striim-node-0
DEV-55496: mo2data-dev went offline state due to high memory usage
DEV-55576: agent as service doesn't work in Windows
DEV-55633: BigQuery Writer - duplicate data with null values
DEV-55666: Jira Reader converts text formatting to special characters
DEV-55683: Salesforce CDC Reader - stream preview not displaying events
DEV-55719: OJet - test connection is not working when property variable is used
DEV-55751: Salesforce CDC Reader performance issues
DEV-55817: ROUND_FLOAT function always returning a fixed value of -2.1474836 when value less than -2
DEV-55835: Salesforce Reader: Inconsistent values between DB and Salesforce IL
DEV-55912: System$OTelMonitoring.OtelMonitoringApp got terminated in Striim Cloud on Azure
DEV-55922: BigQuery Writer - fails with null pointer exception
DEV-55943: Import failed - validation of exceptionhandler details failed
DEV-55951: DeltaLake Writer with externalStageType=ADLSGen2: PATH_NOT_FOUND
DEV-56009: Application Progress screen - Last Update time on all tables showing as "Fetching"
DEV-56033: application progress is not reflected in GUI monitoring stats
DEV-56040: Snowflake Writer - sequence number reset causing data loss
DEV-56062: unable to clean OJet application source when deployed on agent and using vault or property variable
DEV-56096: cluster node went down and did not come back in healthy state
DEV-56195: PostgreSQL Writer - datatype issue with Alloy
DEV-56209: MSJet hangs after running for a couple of days
DEV-56295: app stuck at Stopping state
DEV-56320: OJet - lag up to 10 minutes
DEV-56377: BigQuery Writer - support ignorable exception NOT_NULL_CONSTRAINT in optimised merge mode
DEV-56449: persistent stream stuck in an infinite loop with slow Kafka
DEV-56483: UI is still slow after upgrading to 5.2.0
DEV-56512: persisted stream replays from latest offset rather than from beginning: as part of this fix, the Kafka consumer property auto.offset.reset=earliest is hard-coded and can not be set differently
DEV-56611: table mapping validation not working as expected, NPE thrown
DEV-56689: Spanner PGDialect Writer - KeyColumns forcing a PK_UPDATE
DEV-56815: MongoDB Reader takes too long to start for version 4.0
DEV-56854: OJet - ALTER SOURCE CLEAN EXTERNALPROCESSES IN Agents: Unable to find the Server or Agent
DEV-56863: Microsoft 365 - .jar mismatch
DEV-56898: application stuck in STARTING SOURCES for more than a day
DEV-56942: PostgreSQL Reader > Database Writer (Oracle) - two records missing
DEV-56952: MongoDBWriter writes NaN numeric values as strings
DEV-57010: GAX threads cause memory exhaustion in Striim server
DEV-57088: OJet > persisted stream - data loss
DEV-57096: MSJet: ALTER INDEX ... REBUILD PARTITION: Failure in Executing Queries External Exception Partition metadata
DEV-57145: Ojet - "Invalid Input Number" error due to empty value in NUMBER column
DEV-57156: Salesforce CDC - Missing metadata fields in update events causing NULL overwrite in target
DEV-57222: replication factor is not set in the Kafka topic when the property set has 'topicconfig' defined
DEV-57485: BigQuery Writer - many inserts and deletes not being replicated to target
DEV-57569: UI session management leaves customers disabled and unable to use Striim 5.4
DEV-57632: Fabric Writer failed with "The bulk load failed. Unexpected NULL value in data file row 1, column x "
Customer-reported issues fixed in release 5.4.0.2
DEV-44356: "Test Connection" link not working in vaults
DEV-47085: transaction cache should always close the buffer if the app is closed
DEV-48052: MSJet Mine mode : Processing rate is very slow when reading from backup files
DEV-50091: Striim agent removed from cluster automatically, cause NOT_ENOUGH_SERVERS
DEV-50976: Event Hub Writer: java.lang.ClassCastException: Failed to process monitoring batch event<>/li>
DEV-51140: update Databricks JDBC driver<>/li>
DEV-51244: Snowflake Reader > S3 performance issue with Parquet Formatter
DEV-51967: OJet - Failed with "Archive log with seq# 'xxx' is not available."
DEV-52044: adding component at UI shows: Error Code: [UE - 174403722966]
DEV-52101: Oracle Reader issue with SQL parsing
DEV-52219: Oracle Reader old connections are not closed before connection retry
DEV-52413: MSJet process spawned from Agent running as service exceeds memory limits defined in agent.conf/wrapper.conf
DEV-52698: Oracle Reader timestamp fixes as java.time
DEV-52698: Oracle Reader timestamp precision issue
DEV-52740: OJet issue with large number of tables
DEV-52807: OJet - Unable to drop app! No suitable driver found for - with ssl and property variables
DEV-52875: monitoring metrics are frozen in multi-server cluster
DEV-52892: exported TQL with open processor cannot be imported
DEV-52896: SnowflakeWriter - Missed soft-delete record that converted from ChangeOperationToInsert
DEV-52960: ServiceNow Reader failed to send ACL-protected data, leading to an ArrayIndexOutOfBoundsException: null in BigQuery Writer
DEV-53280: For CLOB insert operation, Rollback operation on the Insert events are not filtered
DEV-53297: ServiceNow Reader: logs the exception: java.lang.NumberFormatException: Illegal embedded sign character
DEV-53328: BigQuery Writer "Table Not Found" error
DEV-53346: MSJet - QueryTimeout issue
DEV-53330: app is not checkpointing
DEV-53369: Failure to create type using DSVParser MAP feature
DEV-55397: Output metrics are not shown in the UI
DEV-53498: OJet - Downstream OJet failed with "ORA-01291: missing log file" when primary db is RAC
DEV-53761: Apps failed with "NOT ENOUGH SERVER"
DEV-53788: MSJet Native (C++) thread still running even after the Halt state
DEV-53812: Initial load app failed with "TABLE_OR_VIEW_ALREADY_EXISTS" - Connection not initialised on restart
DEV-53820: MSJet Mine Mode - ArrayIndexOutOfBoundsException in PRP Layer
DEV-53876: DDLs on uninterested tables should not results in messages in logs and UI
DEV-53894: Databricks - Failed with [TABLE_OR_VIEW_NOT_FOUND] on Staging Table - Problem in Pre-Ret
DEV-54064: App with oracle reader failed: Error : 2008 : Failure in executing queries null
DEV-54253: Archive log gap seen at downstream db
DEV-54264: Databricks stage tables not being dropped
DEV-54322: OJet - "Failed to access the source database from downstream using db link"
DEV-54337: View all Apps page takes a long time to load
DEV-54361: Excluded Tables not working in Incremental Batch Reader
DEV-54489: Applications stuck in inconsistent state — unable to undeploy or drop app
DEV-54595: Forwarding Agent will not run as a service in Windows
DEV-54598: Ojet without PUBLIC database link in downstream setup
DEV-54629: web UI console cursor issues
DEV-54686: MSJet Mine - Implement retry when "No backup found that contains LSN"
DEV-54702: OJet - When specifying SSL related connection details to OJet setup connectionURL validation needs to be disabled
DEV-54745: MSJet fails with "Error in createScript scripts/trayMessage.gv"
DEV-54843: MSJet Mine mode - Frequent Query timeout, Stops hangs on larger backup processing
DEV-54857: MSJet app hanging while stopping
DEV-54920: Spanner PG Dialect Writer overwrites column value on target with NULL
DEV-54954: Handle privilege checks in OJet when public db link is disabled
DEV-54989: OJet Downstream (Non-CDB) – Application remains in RUNNING state but events are not captured
DEV-54990: Fetchsize in MSjet
DEV-55037: Jira reader does not capture data from Votes objects
DEV-55038: BigQueryWriter taking more time to start
DEV-55063: Support KeyColumns for Spanner PG Dialect Writer and Spanner Writer
DEV-55095: OJet in non-CDB to 21c CDB downstream fails with ORA-65090
DEV-55147: Warning messages are flooding the server log
DEV-55157: Increase the log retention policy for striim_mssqlnativereader.log to 200MB
DEV-55176: OJet disable the downstream seq validation
DEV-55182: Batching Support in PRP
DEV-55258: Destroy Connection Object in native layer from the previous run of MSJet for the same app name
DEV-55311: streamproxy degrades the throughput by 10-15x
DEV-55361: NPE Happened at Batch PRP Layer - Float, Real, Smalldatetime, UniqueIdentifier
DEV-55364: Datetime2 - Replicated Incorrectly to Target - BatchPRP MSJET Mine Mode
DEV-55370: Golden Gate (BLOB) > Spanner (BYTEA) Image corruption
DEV-55397: Output metrics are not shown in the UI
DEV-55435: One app hung at stopping state, recreating a new app hung at deploying state
DEV-56496: service went offline
DEV-55576: agent as service doesn't work in Windows
DEV-55633: BigQuery Writer - duplicate Data with null values
DEV-55666: Jira Reader converts text formatting to special characters
DEV-55719: OJet - test connection is not working when property variable is used
DEV-55775: initial load applications stuck on Stopping state
DEV-55834: Kafka Writer publishes DDL key schema with uppercase column names
DEV-55895: SpannerPGDialectWriter - Commit timestamp columns with KeyColumns (SQL) causing failures
DEV-55912: System$OTelMonitoring.OtelMonitoringApp got terminated in SAAS Azure
DEV-55922: BigQuery Writer fails with NullPointerException
DEV-55951: Databricks Writer with externalStageType=ADLSGen2: "PATH_NOT_FOUND"
DEV-56008: OracleReader Cause: Closed Resultset: next
DEV-56009: pplication Progress screen - Last Update time on all tables showing as "Fetching"
DEV-56012: BigQuery Writer fails with "NOT_FOUND: Requested entity was not found"
DEV-56035: Support for table having Autogenerated Column Value in PG/Google dialect SpannerWriter
DEV-56040: Snowflake Writer- duplicate row detected during DML action
DEV-56094: Inconsistent column name casing after DDL change
DEV-56274: SpannerPG Dialect writer app halts due to duplicate row in hotfix/5.0.6.2D
Known issues in release 5.4.0.2
DEV-52582: Striim UI doesn't allow multiple HPNonStopSQLMPReader tables to be specified
DEV-54307: Kafka Writer converts all source column names to uppercase
Customer-reported issues fixed in release 5.4.0.1
DEV-28135: Database Writer / SQL Server loops on Datatype conversion error instead of CRASH
DEV-39178: UI - Metadata Manager Page not responding when metadata repository is large
DEV-50964: Striim.server.log flooded with exception (*org.apache.hive.service.cli.HiveSQLException:Invalid SessionHandle: SessionHandle) related to DeltaLakeWriter
DEV-50968: CDC App Got Stuck In Stopping Status Even After Agent Is Shutdown
DEV-51904: MSJet - Failed with "java.lang.RuntimeException: Cannot create type xxx "
DEV-51936: PostgreSQL > PostgreSQL: timestamp with infinity value hit error: timestamp out of range: "292269055-12-02 23:00:00.0"
DEV-52293: service offline
DEV-52355: MySQL > MySQL datetime & timestamp values doesn't match and shows timezone difference
DEV-52413: MSJet process spawned from Agent running as service exceeds memory limits defined in agent.conf/wrapper.conf
DEV-52458: Metering thread can cause striim version 5.0.6 to be slow
DEV-52459: Update "analyze metadata" with additional details on the unhealthy components
DEV-52740: OJet application with large number of tables
DEV-52807: OJET - Unable to drop app, no suitable driver found for - with ssl and property variables
DEV-52808: OJET - Test connection is not working when property variable is used
DEV-52822: BigqueryWriter: "Query error: UPDATE/MERGE must match at most one source row for each target row at [1:407]", "reason": "invalidQuery" }
DEV-52864: SSO - Firstname and Lastname not populating from Entra
DEV-52896: SnowflakeWriter - Missed soft-delete record that converted from ChangeOperationToInsert
DEV-52951: SpannerBatchReader doesn't pause under back pressure and continues to read data causing memory increase
DEV-52989: Server log not detailing the document and collection where it fails
DEV-53018: Connection Profile for BigQuery not saving with Google Secrets Manager
DEV-53035: MSJet - Missing the timestamp datatype column
DEV-53067: SchemaRegistry SubjectNameMapping is replacing the user supplied character
DEV-53079: UI File upload doesn't allow files starting with . (dot) considering it as hidden files
DEV-53097: Striim Failing to Start Due to Invalid Index Name Starting with Underscore
DEV-53104: PostgreSQL > Oracle hit error for timestamp in BC
DEV-53357: UploadedFiles in UI displays files for a split second and it disappears
DEV-53364: JMXReader hits NPE
DEV-53387: InitialLoad: PostgreSQL > PostgreSQL bit datatype fails
DEV-53401: Databricks :App crash frequently with Error [TABLE_OR_VIEW_NOT_FOUND] - pre retry issue
DEV-53416: PostgreSQL Reader - Failed with error "Invalid format: "infinity""
DEV-53498: OJET - Downstream OJET failed with "ORA-01291: missing log file" when primary db is RAC
DEV-53529: Mysql to Snowflake App hung until restart
DEV-53530: Mysql - Mysql Date value data mismatch
DEV-53607: SSO configuratio accepts base64 Certificate Based on File Extension (.pem) instead of validating Content
DEV-53634: DatabaseWriter (SQLServer): Performance Degradation on Wide Tables Due to Decimal and Smallint Columns
DEV-53761: Apps failed with "NOT ENOUGH SERVER"
DEV-53794: GG Trail reader failing with "com.webaction.Exception.GGExternalException: Unsupported TDR Version - { 19 }"
DEV-53812: Initial load app failed with "TABLE_OR_VIEW_ALREADY_EXISTS" - Connection not initialised on restart
DEV-53813: UI is behaving weirdly
DEV-53856: Metrics exposed by striim does not include the node name & some of the metrics are missing
DEV-53876: DDLs on uninterested tables should not results in messages in logs and UI
DEV-53894: Databricks - Failed with [TABLE_OR_VIEW_NOT_FOUND] on Staging Table - Problem in Pre-Retry
DEV-53906: GUI Spins and Never Loads after the first login
DEV-54006: Missing Single Sign On Tab when the Hostname in DNS Name in Striim UI
DEV-54089: Oracle CDC app did not Halted/Terminated when struck with no log file found
DEV-54241: mysql terminated: java.lang.ArrayIndexOutOfBoundsException
DEV-54250: PIL :: Patch request for https://webaction.atlassian.net/browse/DEV-53401
DEV-54266: Salesforce CDC Reader: When the Start Time is not epoch, error message mentions it as fetch size incorrect
DEV-54272: java.lang.IllegalArgumentException: No enum constant com.webaction.runtime.meta.MetaInfo.StatusInfo.Status.TERMINATED
DEV-54288: Kafka Writer : ClusterAuthorizationException: Cluster authorization failed
DEV-54309: App gets stuck (no reads or writes) after loading 1.159 Million records into Fabric Data Warehouse. Source has 5 Million records
DEV-54370: App got stuck in Stopping Status
DEV-54407: Striim Email Alert not sending the alerts
DEV-54419: UI Doesn't Allow for Setting Multiple Fields as Keys for a Typed Event
DEV-54477: Inconsistent app execution When processing CSV fils using S3reader :DSVParser
DEV-54480: striim.server.log contains repeated message(-WARN Thread
DEV-54501: Mariadb terminated: java.lang.ArrayIndexOutOfBoundsException
DEV-54514: DIGILE/MBSB : IL App's remains in running state after data load completion
DEV-54579: OJet does not use unique constraint as key for newly created table
DEV-54686: MSJet Mine - Implement retry when "No backup found that contains LSN"
DEV-54787: Jira reader: HTTP [40002] Too many operands passed to JQL query
DEV-54789: IL (oracle -> databricks): 'Create Schema' causes mismatch for NUMBER and DATE
DEV-54839: Incomplete “Suggested Actions” section in exception message
DEV-54843: MSJet Mine mode - Frequent Query timeout, Stops hangs on larger backup processing
DEV-54932: App stops or terminates, not closing db session.
DEV-55020: Potential thread leak for USER_NOTIFICATION_QUEUEback-end<token>
DEV-55096: Oracle19c (not container, primary) -> Oracle21c (downstream) setup
DEV-55224: Destroy Connection Object in native layer from the previous run of MSJet for the same app name.
DEV-55242: Key Attribute Showing NULL for ZipID in Kafka Offset Explorer
DEV-55266: Special character and case-sensitivity issues in Kafka message key and value schema field names
DEV-55319: Password is printed in agent log as clear text format
Known issues from past releases
DEV-5701: Dashboard queries not dropped with the dashboard or overwritten on import
When you drop a dashboard, its queries are not dropped. If you drop and re-import a dashboard, the queries in the JSON file do not overwrite those already in Striim.
Workaround: drop the namespace or LIST NAMEDQUERIES, then manually drop each one.
DEV-8142: SORTER objects do not appear in the UI
DEV-8933: DatabaseWriter shows no error in UI when MySQL credentials are incorrect
If your DatabaseWriter Username or Password values are correct, you will see no error in the UI but no data will be written to MySQL. You will see errors in webaction.server.log regarding DatabaseWriter containing "Failure in Processing query" and "command denied to user."
DEV-11305: DatabaseWriter needs separate checkpoint table for each node when deployed on multiple nodes
DEV-17653: Import of custom Java function fails
IMPORT STATICmay fail. Workaround: use lowercaseimport static.DEV-19903: When DatabaseReader Tables property uses wildcard, views are also read
Workaround: use Excluded Tables to exclude the views.
Third-party APIs, clients, and drivers used by readers and writers
Azure Event Hub Writer uses the azure-eventhubs API version 3.0.2.
Azure Synapse Writer uses the bundled SQL Server JDBC driver.
BigQuery Writer uses google-cloud-bigquery version 2.42.3 and google-cloud-bigquerystorage version 3.9.1.
Cassandra Cosmos DB Writer uses cassandra-jdbc-wrapper version 3.1.0
Cassandra Writer uses cassandra-java-driver version 3.6.0.
Cloudera Hive Writer uses hive-jdbc version 3.1.3.
CosmosDB Reader uses Microsoft Azure Cosmos SDK for Azure Cosmos DB SQL API 4.54.0.
CosmosDB Writer uses documentdb-bulkexecutor version 2.3.0.
Databricks Writer uses Databricks JDBC driver version 2.6.29. It also uses the following:
for authentication using Azure Active Directory and staging in ADLS Gen2: azure-identity version 1.5.3
for staging in ADLS Gen2: azure-storage-blob version 12.18.0
for staging in DBFS: databricks-rest-client version 3.2.2
for staging in S3: aws-java-sdk-s3 version 1.12.589 and aws-java-sdk-sts version 1.11.320
Derby: the internal Derby instance is version 10.9.1.0.
Elasticsearch: the internal Elasticsearch cluster is version 5.6.4.
Fabric Data Warehouse Writer uses mssql-jdbc version 12.8.1.jre8, msal4j version 1.17.1, and azure-storage version 4.4.0.
Fabric Lakehouse File Writer uses httpclient version 4.5.13.
GCS Writer uses the google-cloud-storage client API version 1.106.0.
Google PubSub Writer uses the google-cloud-pubsub client API version 1.110.0.
Hazelcast is version 5.3.5.
HBase Writer uses HBase-client version 2.4.13.
Hive Writer and Hortonworks Hive Writer use hive-jdbc version 3.1.3.
The HP NonStop readers use OpenSSL 1.0.2n.
JMS Reader and JMS Writer use the JMS API 1.1.
Kafka: the internal Kafka cluster is version 3.6.2.
Kudu: the bundled Kudu Java client is version 1.13.0.
Kinesis Writer uses aws-java-sdk-kinesis version 1.11.240.
MapR DB Writer uses hbase-client version 2.4.10.
MapR FS Reader and MapR FS Writer use Hadoop-client version 3.3.4.
MariaDB uses maria-binlog-connector-java-0.2.3-WA1.jar and mariadb-java-client-2.4.3.jar.
MariaDB Xpand uses mysql-binlog-connector-java-0.21.0.jar and mysql-connector-java-8.0.30.jar.
Mongo Cosmos DB Reader, MongoDB Reader, and MongoDB Writer use mongodb-driver-sync version 4.8.2.
MySQL uses mysql-binlog-connector-java-0.21.0.jar and mysql-connector-java version 8.0.27.
Oracle: the bundled Oracle JDBC driver is ojdbc-21.6.jar.
PostgreSQL: the bundled PostgreSQL JDBC 4.2 driver is postgresql-42.4.0.jar.
Redshift Writer uses aws-java-sdk-s3 1.11.320.
S3 Reader and S3 Writer use aws-java-sdk-s3 1.11.320.
Salesforce Reader always uses the latest version of the Force.com REST API.
Salesforce Writer: when Use Bulk Mode is True, uses Bulk API 2.0 Ingest; when Use Bulk Mode is False, uses the Force.com REST API version 53.1.0.
Snowflake Reader: the bundled Snowflake JDBC driver is snowflake-jdbc-3.18.0.jar.
Snowflake Writer: when Streaming Upload is False, uses snowflake-jdbc-3.18.0.jar; when Streaming Upload is True, uses snowflake-ingest-sdk version 2.2.2.
Spanner Writer uses the google-cloud-spanner client API version 1.28.0 and the bundled JDBC driver is google-cloud-spanner-jdbc version 1.1.0.
SQL Server: the bundled Microsoft SQL Server JDBC driver is mssql-jdbc-12.8.1.jre8.jar.
Yugabyte: uses the bundled PostgreSQL JDBC driver.