Google BigQuery table disappears after a few days

0
votes

I'm streaming data using bigquery, but somehow the table I created will disappear from WebUI while the dataset will remain.

I set up the dataset as never expire, is there any configuration for the table itself?

2
google-bigquery
I had the same problem when I created the dataset and table with bq command line. It defaults table expiration set for one hour unless you specify. I had to change manually on the WebUI or command line - Jijo John

2 Answers

1
votes

I'd look into Mikhail's suggestion of the table's explicit expiration time. The tables could also be getting deleted via the tables.delete API, possibly by another user or process. You could check operations on your table in your project's audit logs and see if something is deleting them.

0
votes

is there any configuration for the table itself?

Expiration that is set for dataset is just default expiration for newly created tables
Table itself can be set with expiration using expirationTime property