Skip to content

Nested schema issue #18

@SpacedDot

Description

@SpacedDot

Hi, I try to export BQ data to bucket using this command :
bash ethereum_bigquery_to_gcs.sh $BUCKET 2020-01-01 2020-01-31

But I get a error for block:

Extracting export_temp_dataset.bigquery_public_data_crypto_ethereum_blocks_filtered to gs://bucket_s1/bigquery_public_data_crypto_ethereum_blocks_filtered_raw/*.gz ...
BigQuery error in extract operation: Error processing job 'syj553:bqjob_r56ef771b811f325a_00000187719111cb_1': Operation cannot be performed on a nested schema. Field: withdrawals
Composing files in gs://bucket_s1/bigquery_public_data_crypto_ethereum_blocks_filtered_raw/ to gs://bucket_s1/bigquery_public_data_crypto_ethereum_blocks_filtered_composed/
Composing files in gs://bucket_s1/bigquery_public_data_crypto_ethereum_blocks_filtered_composed/ to gs://bucket_s1/bigquery_public_data_crypto_ethereum_blocks_filtered/
CommandException: 1 files/objects could not be removed.
CommandException: 1 files/objects could not be removed

I did some searching and it's about the nested schema.
But I thought this script should work fine.
Is there something change for the bigquery_public_data.crypto_ethereum ? Or did I miss something?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions