S3
Last updated: 10 Oct 2023
Description¶
The S3 Export node exports a data set to an AWS S3 bucket.
Configuration Options¶
Basic Configuration Options¶
| Setting | Description\Parameters |
|---|---|
S3 Connection |
The S3 connection to query against. These connections can be configured in Flow Connections. |
Bucket |
The bucket from which to pull data. |
Folder |
The (optional) folder from which to pull data. If permissions are set to only allow access to objects in a specific folder, this field is required to be able to browse available files. |
File |
The file from which to pull data. This is the full path of the bucket file. |
Write Mode |
Specifies the upload mode. Options |
- Recreate
- Create/recreate the file in its entirety. Any existing files with the same name will be overwritten.
- Insert
- Create/append to existing files. If a file with the same name already exists, append the dataframe content to that file. NB: the dataframe data is directly appended to the bottom of the existing file. No other data checks are performed, ensure that the existing S3 file can be appended to.
Delimiter|Specifies the delimiter used to parse the selected file. Options
- Comma
- Tab
- Pipe
|
|First Row is Header|Specifies if the first row in the file should be loaded as row header metadata. If this box is checked, the first row will be loaded as header metadata.|
|Decimal Places|Specifies the number of decimal places to which any Double data type columns will be truncated.|
|Write Mode|Table options are Recreate, Insert.
Actions¶
| Action | Description |
|---|---|
Run |
Once the node is configured, you can generate output at any time. |