Import GAE data through Storage into BigQuery fails

0
votes

In Google App Engine I created a backup using the Datastore Admin. I selected Google Cloud Storage as the destination and now I have a bucket with my backup.

Now I'm trying to import that data into BigQuery.

On the website I created a new dataset and clicked "Create new table". At the "Select data" step I selected AppEngine Datastore Backup and "Load data from Google Cloud Storage gs://mybucket".

At that point I always get this error:

"Source URI must be a Google-Storage location: gs://mybucket"

On the site the bucket seems just fine: https://storage.cloud.google.com/

And gsutil ls gs://mybucket also works, so I'm not sure what the problem is.

Is there still some other ACL or something that I need to set?

1
google-app-enginegoogle-bigquerygoogle-cloud-storage
Did you try with a trailing / ? - jterrace
Yes. Got the same error message. - Christiaan
Do you have any strange characters in the bucket name? - jterrace
No, only lowercase alphanumeric. No underscores or anything. - Christiaan

1 Answers

1
votes

You need to specify the full path to the backup_info file.

For instance, the location could be something like this:

gs://my_bucket/RhdGFzd9yS1hZ1pbi1vem.ReservationData.backup_info

You should be able to see this filename when you execute your gsutil ls gs://mybucket command.