Credentials Error when integrating Google Drive with

Question

I am using Google Big Query, I want to integrate Google Big Query to Google Drive. In Big query I am giving the Google spread sheet url to upload my data It is updating well, but when I write the query in google Add-on(OWOX BI Big Query Reports):

Select * from [datasetName.TableName]

I am getting an error:

Query failed: tableUnavailable: No suitable credentials found to access Google Drive. Contact the table owner for assistance.

Answer 1

I just faced the same issue in a some code I was writing - it might not directly help you here since it looks like you are not responsible for the code, but it might help someone else, or you can ask the person who does write the code you're using to read this :-)

So I had to do a couple of things:

1. Enable the Drive API for my Google Cloud Platform project in addition to BigQuery.
2. Make sure that your BigQuery client is created with both the BigQuery scope AND the Drive scope.
3. Make sure that the Google Sheets you want BigQuery to access are shared with the "[email protected]" account that your Google Cloud Platform identifies itself as.

After that I was able to successfully query the Google Sheets backed tables from BigQuery in my own project.

Answer 2

What was previously said is right:

1. Make sure that your dataset in BigQuery is also shared with the Service Account you will use to authenticate.
2. Make sure your Federated Google Sheet is also shared with the service account.
3. The Drive Api should as well be active
4. When using the OAuthClient you need to inject both scopes for the Drive and for the BigQuery

If you are writing Python:

5. credentials = GoogleCredentials.get_application_default() (can't inject scopes #I didn't find a way :D at least

6. Build your request from scratch:

   scopes = ( 'https://www.googleapis.com/auth/drive.readonly', 'https://www.googleapis.com/auth/cloud-platform')

   credentials = ServiceAccountCredentials.from_json_keyfile_name(
       '/client_secret.json', scopes)
   
   http = credentials.authorize(Http())
   
   bigquery_service = build('bigquery', 'v2', http=http)
   
   query_request = bigquery_service.jobs()
   query_data = {
       'query': (
           'SELECT * FROM [test.federated_sheet]')
   }
   
   query_response = query_request.query(
       projectId='hello_world_project',
       body=query_data).execute()
   
   print('Query Results:')
   for row in query_response['rows']:
       print('\t'.join(field['v'] for field in row['f']))
   

Answer 3

This likely has the same root cause as: BigQuery Credential Problems when Accessing Google Sheets Federated Table

Accessing federated tables in Drive requires additional OAuth scopes and your tool may only be requesting the bigquery scope. Try contacting your vendor to update their application?

Answer 4

If you're using pd.read_gbq() as I was, then this would be the best place to get your answer: https://github.com/pydata/pandas-gbq/issues/161#issuecomment-433993166

import pandas_gbq
import pydata_google_auth
import pydata_google_auth.cache

# Instead of get_user_credentials(), you could do default(), but that may not
# be able to get the right scopes if running on GCE or using credentials from
# the gcloud command-line tool.
credentials = pydata_google_auth.get_user_credentials(
    scopes=[
        'https://www.googleapis.com/auth/drive',
        'https://www.googleapis.com/auth/cloud-platform',
    ],
    # Use reauth to get new credentials if you haven't used the drive scope
    # before. You only have to do this once.
    credentials_cache=pydata_google_auth.cache.REAUTH,
    # Set auth_local_webserver to True to have a slightly more convienient
    # authorization flow. Note, this doesn't work if you're running from a
    # notebook on a remote sever, such as with Google Colab.
    auth_local_webserver=True,
)

sql = """SELECT state_name
FROM `my_dataset.us_states_from_google_sheets`
WHERE post_abbr LIKE 'W%'
"""

df = pandas_gbq.read_gbq(
    sql,
    project_id='YOUR-PROJECT-ID',
    credentials=credentials,
    dialect='standard',
)

print(df)