BigQuery External Data Source Query Quotas

Question

I have a BigQuery table set up with a Cloud BigTable external data source. This works fine, and I'm able to run queries joining my BigTable data to some of my other BigQuery data. However, when I run too many queries against this table simultaneously, I get the following error:

Error encountered during job execution: Exceeded rate limits: too many concurrent queries that read Cloud Bigtable data sources for this project. For more information, see https://cloud.google.com/bigquery/troubleshooting-errors

I can't find any documentation about the limits on concurrent queries on the linked page or on the BigQuery Quotas and Limits page. I'm not running that many queries here - max 10 at a time. Has anyone run into this before who knows what the actual concurrent query limit is?

edit:

So people don't have to dig through the attached Google ticket, the correct answer (as of April 2018) is 4 concurrent queries.

Answer 1

You should rather look for Quotas & Limits for Query Jobs

The following limits apply to query jobs created automatically by running interactive queries and to jobs submitted programmatically using jobs.query and query-type jobs.insert method calls.

Concurrent rate limit for on-demand, interactive queries — 50 concurrent queries Queries with results that are returned from the query cache, and dry run queries do not count against this limit. You can specify a dry run query using the --dry_run flag or by setting the dryRun property in a query job.

Concurrent rate limit for queries that contain user-defined functions (UDFs) — 6 concurrent queries The concurrent rate limit for queries that contain UDFs includes both interactive and batch queries. Interactive queries that contain UDFs also count toward the concurrent rate limit for interactive queries.

you cn find more in provided link