You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently all extract jobs are being run with a * wildcard name, meaning BigQuery can create multiple files at its own discretion. For large queries or partitioned tables, this will pretty much always result in multiple files, even if not strictly necessary based on file size limits.
Two possibilities to consider:
An option or default to try one file first, and fail over to wildcard if BigQuery indicates the export was over the limit.
Add the ability for us to concatenate down to a single file before delivery to the final destination.
The text was updated successfully, but these errors were encountered:
Currently all extract jobs are being run with a
*
wildcard name, meaning BigQuery can create multiple files at its own discretion. For large queries or partitioned tables, this will pretty much always result in multiple files, even if not strictly necessary based on file size limits.Two possibilities to consider:
The text was updated successfully, but these errors were encountered: