Fabric Lakehouse File Writer programmer's reference
Fabric Lakehouse File Writer properties
property | type | default value | notes |
---|---|---|---|
Compression Type | String | Set to | |
Connection Retry Policy | String | retryInterval=30, maxRetries=3 | Specifies the number of times and the time interval between subsequent retries the writer tries to upload a file on a connection drop. |
Directory | String | The name of the directory in which files will be written. | |
Filename | String | The base name of the files to be written. See Setting output names and rollover / upload policies for more details. | |
Password | String | Microsoft fabric password. Password used to login to https://app.fabric.microsoft.com | |
Retriable Error Codes | String | 500, 503 | Comma separated list of REST response codes for which the requests would be retried based on the Connection Retry Policy. |
Roll Over On DDL | Boolean | True | Has effect only when the input stream is the output stream of a CDC reader source. With the default value of True, rolls over to a new file when a DDL event is received. Set to False to keep writing to the same file. |
Upload Policy | String | eventcount:10000, interval:5m | The upload policy may include eventcount, interval, and/or filesize (see Setting output names and rollover / upload policies Setting output names and rollover / upload policies for syntax). Cached data is written to a file every time any of the specified values is exceeded. With the default value, data will be written every five minutes or sooner if the cache contains 10,000 events. When the app is quiesced, all remaining data is written to files. |
URL | String | URL of the Onelake "Files" folder. For example: https://onelake.dfs.fabric.microsoft.com/<workspace>/<item>.lakehouse/Files | |
Username | String | Microsoft fabric username. The username used to login to https://app.fabric.microsoft.com |