Snowflake initial setup
For initial load, see Snowflake initial load.
For continuous real-time replication, see Snowflake continuous real-time replication using CDC.
For continuous incremental replication, see Snowflake continuous incremental replication.
The following discussions of networking and security apply to both initial load and either approach to continuous replication.
Networking setup
You need to establish proper network connectivity between your Striim environment and the Snowflake database. This involves configuring network access, firewall rules, and connection parameters to ensure reliable communication.
Ensure that the Striim server can connect to your Snowflake database on the correct port (typically 3306). If your Snowflake database is behind a firewall, you need to configure the necessary firewall rules to allow inbound connections from the Striim server. For cloud deployments, such as Amazon RDS for Snowflake, you need to configure security groups to allow access from your Striim instance.
Also consider network latency and bandwidth requirements, especially for high-volume CDC scenarios. For optimal performance, minimize the network latency between Striim and Snowflake.
Security
Security configuration for Snowflake integration involves multiple layers, including authentication, authorization, network security, and data protection measures.
You must implement proper authentication mechanisms between Striim and Snowflake. This includes creating dedicated database users with minimal required privileges following the principle of least privilege. You should avoid using administrative accounts and instead create specific users for Striim operations with only the necessary permissions for the tables and operations required.
You should implement access control at multiple levels, including database-level permissions, schema-level access controls, and table-level privileges. You should regularly review and audit the permissions granted to Striim users and implement proper password policies and rotation procedures for service accounts.