Contents x
    S3
    • 10 Oct 2023
    • 1 Minute to read
    • Print
    • Dark
      Light
    Contents

    S3

    • Updated on 10 Oct 2023
    • 1 Minute to read
    • Print
    • Dark
      Light
    Article summary

    Description

    The S3 Source Node is used to import data from Amazon S3.


    Configuration Options

    Basic Configuration Options

    SettingDescription\Parameters
    S3 ConnectionThe S3 connection to query against. These connections can be configured in Flow Connections.
    BucketThe bucket from which to pull data.
    FolderThe (optional) folder from which to pull data. If permissions are set to only allow access to objects in a specific folder, this field is required to be able to browse available files.
    FileThe file from which to pull data. This is the full path of the bucket file.
    DelimiterSpecifies the delimiter that should be used to parse the selected file.

    Options
    • Comma
    • Tab
    • Pipe
    Quote CharacterSpecifies the character used to wrap column data between each delimiter.

    Options
    • Auto - data fields wrapped with default (double quote)
    • None - data fields not wrapped
    • Single - data fields wrapped with single quotes
    • Double - data fields wrapped with double quotes
    First Row is HeaderSpecifies if the first row in the file should be loaded as row header metadata. If this box is checked, the first row will be loaded as header metadata.

    Advanced Configuration Options

    Click the Data Type Assignment button to view these options

    SettingDescription
    Column Data TypeThis setting can be overridden.

    Actions

    ActionDescription
    Infer Data TypesAutomatically infer the data types used for each column. These data types can be overridden in the advanced section.
    PreviewOnce the node is configured, the source data can be previewed at any time. Be sure to Infer Data Types.
    Data Type AssignmentNavigates to the advanced section where you can override data types.

    Misc. Node Requirements

    • This node supports comma, pipe, and tab-delimited files only.
    • Data must be formatted to conform to standard delimited file conventions. For example, each row should be terminated by a new line (\r\n).
    • Rows should not contain \r or \n characters outside of the newline.
    Was this article helpful?
    What's Next