Big Query exports

1
votes

I am trying to export some data from Big Query. This is done by first saving the table and then exporting it to google cloud storage. This used to work just fine but recently apparently some tables have nested schemas so exporting as csv does not work anymore. Exporting as a JSON should work, and the export job claims to succeed, but data is not available on google cloud storage. Anyone experiencing similar issues? Is Google having some problems?

Thanks!

2
google-bigquerygoogle-cloud-storage
Can you please provide JobId for the export job which claims to succeed but no files created so Google can investigate - Mosha Pasumansky
Job ID is bquijob_27c77663_15747a8ba12 - YMDH
job id needs to be qualified by project name (or id) where it ran to be able to look it up. - Mosha Pasumansky

2 Answers

0
votes

well, you can either export them as JSON or flatten the nested fields.

See here the official documentation or this other question on the matter

Did it work?

0
votes

Apparently there is a 5GB limit on the buckets in google cloud which prevented us from exporting our datasets. Pity that the job doesn't just fail with an outofstorage error.