READ_PARQUET
A table-valued function (TVF) that accepts a URL to an Amazon bucket containing a Parquet file and credentials. READ_PARQUET
returns a table with data from the specified Parquet file.
Syntax
READ_PARQUET (
url => <file_url>
[, aws_key_id => <aws_key_id>]
[, aws_secret_key => <aws_secret_key>]
)
Parameters
Parameter | Description | Supported input types |
---|---|---|
<url> | The location of the Amazon S3 bucket containing your files. The expected format is s3://{bucket_name}/{full_file_path} . | TEXT |
<aws_key_id> | The AWS key ID. | TEXT |
<aws_secret_key> | The AWS secret key. | TEXT |
The following apply:
-
The
url
can be passed as either the first positional parameter or a named parameter. For example, the following two queries will both read the same file:SELECT * FROM READ_PARQUET('s3://firebolt-publishing-public/help_center_assets/firebolt_sample_dataset/playstats/TournamentID=92/cc2a2a0b4e8b4fb39abf20a956e7cc3e-0.parquet'); SELECT * FROM READ_PARQUET(url => 's3://firebolt-publishing-public/help_center_assets/firebolt_sample_dataset/playstats/TournamentID=92/cc2a2a0b4e8b4fb39abf20a956e7cc3e-0.parquet');
-
Credentials are optional.
-
If you provide either
aws_key_id
oraws_secret_key
, you must provide both.
Return Type
The result is a table with data from the Parquet files. Columns are read and parsed using their inferred data types.
Example
Query: In the following example, the url
is set as the first positional parameter and reads a Parquet file.
SELECT * FROM READ_PARQUET('s3://firebolt-publishing-public/help_center_assets/firebolt_sample_dataset/playstats/TournamentID=92/cc2a2a0b4e8b4fb39abf20a956e7cc3e-0.parquet') LIMIT 5;
Returns:
GameID | PlayerID | Timestamp | SelectedCar | CurrentLevel | CurrentSpeed | CurrentPlayTime | CurrentScore | Event | ErrorCode |
---|---|---|---|---|---|---|---|---|---|
1 | 845 | 2022-10-27 13:36:33 | Solara | 1 | 0 | 0 | 0 | Brake | NoError |
1 | 845 | 2022-10-27 13:36:33 | Solara | 1 | 339 | 0.9872 | 2 | RightTurn | GraphicsFreeze |
1 | 845 | 2022-10-27 13:36:34 | Solara | 1 | 288 | 1.9744 | 20 | Tilt | NoError |
1 | 845 | 2022-10-27 13:36:35 | Solara | 1 | 260 | 2.9616 | 53 | Block | TextNotFound |
1 | 845 | 2022-10-27 13:36:36 | Solara | 1 | 196 | 3.9488 | 81 | FullSpeed | NoError |