How can I get 'Bytes processed' and 'Bytes billed' when reading from Bigquery Storage API (python)

0
votes

I'm reading data from partitioned and clustered BigQuery table. The only way to get exactly the 'Bytes processed' value is to actually run the query.

Now if I'm reading the same data using python client library for Storage API, (taking setup from https://github.com/googleapis/python-bigquery-storage/blob/master/samples/quickstart.py) How can I get 'bytes processed' in this case?

2
google-bigquery
Was your question answered? - rmesteves
The answer didn't answer the question. Your comment did however. Don't know how to mark it in this case. - Juri Krainjukov
I could post it as an answer so - rmesteves

2 Answers

1
votes

As I commented, BigQuery Storage API and BigQuery API works differently.

As you can see in the API reference for BigQuery Storage API, there is not such fields that hold the required information about bytes processed.

I hope it helps

0
votes

Bytes processed is measured when the storage API reads the column files. In your Java example you do that by invoking the storage API. In BQ this is only invoked when you run the query.

If you just edit the query in the console, BQ will give you an estimate only.