S3

  • Updated on Oct 10, 2023
  • Published on Oct 6, 2023
  • 1 minute(s) read
Prev Next

Description

The S3 Export node exports a data set to an AWS S3 bucket.


Configuration Options

Basic Configuration Options

Setting Description\Parameters
S3 Connection The S3 connection to query against. These connections can be configured in Flow Connections.
Bucket The bucket from which to pull data.
Folder The (optional) folder from which to pull data. If permissions are set to only allow access to objects in a specific folder, this field is required to be able to browse available files.
File The file from which to pull data. This is the full path of the bucket file.
Write Mode Specifies the upload mode.

Options
  • Recreate
    • Create/recreate the file in its entirety. Any existing files with the same name will be overwritten.
  • Insert
    • Create/append to existing files. If a file with the same name already exists, append the dataframe content to that file. NB: the dataframe data is directly appended to the bottom of the existing file. No other data checks are performed, ensure that the existing S3 file can be appended to.
Delimiter Specifies the delimiter used to parse the selected file.

Options
  • Comma
  • Tab
  • Pipe
First Row is Header Specifies if the first row in the file should be loaded as row header metadata. If this box is checked, the first row will be loaded as header metadata.
Decimal Places Specifies the number of decimal places to which any Double data type columns will be truncated.
Write Mode Table options are Recreate, Insert.

Actions

Action Description
Run Once the node is configured, you can generate output at any time.