Flat File

Last updated: 23 Dec 2022

Documentation

Flat File Source

Examples

Load a quoted CSV file with a header

The following file needs to be loaded:

The file above is comma separated, with no quote character around the data fields.

In order to load this file:

1. Reference FlatFileSourceCSV.csv into the File Name input.
2. Select comma for the Delimiter input.
3. Select NONE for the Quote Character input.
4. Click Infer Data Types
5. Click Preview, verify the preview data
6. Click Save

The node is now ready to be connected to another node.

Load an unquoted PSV file

The file above is pipe separated, with no quote character around the data fields.

In order to load this file,

1. Reference FlatFileSourcePSV.psv into the File Name input.
2. Select pipe for the Delimiter input.
3. Select DOUBLE for the Quote Character input.
4. Click Infer Data Types
5. Click Preview, verify the preview data
6. Click Save

The node is now ready to be connected to another node.

Load a CSV file, change field data types

The file above is pipe separated, with no quote character around the data fields.

In order to load this file,

1. Reference FlatFileSourceDataTypesOverride.psv into the File Name input.
2. Select pipe for the Delimiter input.
3. Select DOUBLE for the Quote Character input.
4. Click Infer Data Types
5. Click Advanced
6. Change a field data type
7. Click Preview, verify the preview data
8. Click Save

The node is now ready to be connected to another node.