“Exceeded quota: too many free query bytes scanned for this project” in Google BigQuery

5
votes

I'm getting the above error since yesterday, after trying out Google BigQuery with JasperReports Server. I couldn't find any info on this, since the first 100GB should be free and the BigQuery Access Report is saying:

BigQuery Resource Usage for API Project Data Analysis Jan 31, 2013 – Feb 27, 2013

Data Processed Per Day 0 MB Peak 0.00 MB Average

I haven't reached the free query/user/day limit either: API Per-User Limit Used Billable Limit Courtesy Limit
BigQuery API 5.0 requests/second/user
0% 200,000 requests/day 10,000 requests/day

and

Traffic Reports for API Project Total requests 935 Requests/day 856 peak 33.39 average

Start Date Jan 31, 2013

Sample Period 28 days

I'm trying to use the natality sample data in a project for my university and it's pretty urgent. It was working fine for a day or so. The queries are made by the JasperSoft BigQuery Connector (http://code.google.com/p/jaspersoft-bigquery-datasource/) using an Ad-hoc-View (based on a JasperReport as Topic).

I am using the following statement:

SELECT
    STRING($P!{dimension1}) as dimension_1,
    STRING($P!{dimension2}) as dimension_2,
    SUM(record_weight)  as count_group,
    AVG(weight_pounds)  as avg_weight_pounds,
    AVG(apgar_1min) as apgar_1min,
    AVG(apgar_5min) as apgar_5min
FROM publicdata:samples.natality
WHERE
    year >= $P!{year_first}
    AND year <= $P!{year_last}
GROUP BY dimension_1, dimension_2
ORDER BY dimension_1, dimension_2

Any help would be highly appreciated! Thanks in advance!

1
google-bigqueryquota
What is your project ID? If you include that we can look up your project history. – Jordan Tigani
The project ID should be 793058927795. Thanks! – MisterXtm
Our logs have you doing 125GB of processing in the last 30 days. If it isn't being reported correctly in the developer console that sounds like a bug. I'll investigate. – Jordan Tigani
Since it sounds like this is a university project, and your usage isn't being represented correctly, I've reset your quota. You should have the full 100GB left. If you need more, please enable billing. – Jordan Tigani
Thank you for your answer and for the quota reset!! There must be a problem with the reporting, since I just get 0 GB traffic shown. Nevertheless, I still don't know how I could have made that much processing with that only some selected fields, restricted periods of time & about 20-30 queries in total. – MisterXtm

1 Answers

6
votes

Summarising the comments above and below for anyone else's benefit:

  • The quota for your usage doesn't show up in the developer console if you don't enable billing.
  • Looking at the reports page will show 0GB used if you don't enable billing.
  • Unless you enable billing, you have a limit of 100GB to query per month.
  • Enabling billing will enable you to query more than 100GB of data.
  • The BigQuery team are working on a fix for the reports page not including queries on data when you haven't enabled billing