Contents x
    S3
    • 10 Oct 2023
    • 1 Minute to read
    • Print
    • Dark
      Light
    Contents

    S3

    • Updated on 10 Oct 2023
    • 1 Minute to read
    • Print
    • Dark
      Light
    Article summary

    Description

    The S3 Export node exports a data set to an AWS S3 bucket.


    Configuration Options

    Basic Configuration Options

    SettingDescription\Parameters
    S3 ConnectionThe S3 connection to query against. These connections can be configured in Flow Connections.
    BucketThe bucket from which to pull data.
    FolderThe (optional) folder from which to pull data. If permissions are set to only allow access to objects in a specific folder, this field is required to be able to browse available files.
    FileThe file from which to pull data. This is the full path of the bucket file.
    Write ModeSpecifies the upload mode.

    Options
    • Recreate
      • Create/recreate the file in its entirety. Any existing files with the same name will be overwritten.
    • Insert
      • Create/append to existing files. If a file with the same name already exists, append the dataframe content to that file. NB: the dataframe data is directly appended to the bottom of the existing file. No other data checks are performed, ensure that the existing S3 file can be appended to.
    DelimiterSpecifies the delimiter used to parse the selected file.

    Options
    • Comma
    • Tab
    • Pipe
    First Row is HeaderSpecifies if the first row in the file should be loaded as row header metadata. If this box is checked, the first row will be loaded as header metadata.
    Decimal PlacesSpecifies the number of decimal places to which any Double data type columns will be truncated.
    Write ModeTable options are Recreate, Insert.

    Actions

    ActionDescription
    RunOnce the node is configured, you can generate output at any time.

    Was this article helpful?
    What's Next