Parquet

Jump to Section

Converts the event into a Parquet file. Once formatted, Output Pipeline stages can be used to write the file with a file-based connector such as File or Amazon S3.

Upon format the stage sets event.metadata.fileFormat to parquet.

Note: Value with File datatype are represented with base64 encoded strings when using connectors that transmit data in json format.