App Engine Standard Python Cloud Storage File Not Found

Question

Not sure if this is exactly the same as NotFoundError: Expect status [200] from Google Storage. But got status 404 while reading a file but I have the same problem and I couldn't find a resolution there. I used the Browser to upload a file players2018 to my storage bucket. it's there and I can see it fine in the storage cloud browser. I'm definitely resolving with the right bucket name, which is just the name of my app and it is the same name that appears when I get a link to the file from the Cloud browser. So here's the relevant code:

def bucket_name():
    os.environ.get('BUCKET_NAME', app_identity.get_default_gcs_bucket_name())
    return app_identity.get_default_gcs_bucket_name()

def read_file(filename):
    fn = "/" + bucket_name() + "/" + filename
    logging.debug("Reading" + fn)
    with cloudstorage.open(fn) as cloudstorage_file:
        return cloudstorage_file.readlines()

And I get back:

NotFoundError: Expect status [200] from Google Storage. But got status 404.
Path: '/[Actual Bucket Name]/players2018'.
Request headers: None.
Response headers: {'connection': 'close', 'date': 'Thu, 08 Mar 2018 02:25:32 GMT', 'server': 'Development/2.0'}.
Body: ''.
Extra info: None.

I changed the bucket name to protect the clueless, namely me.

Just to be clear, I'm running this from the dev server, not the app. I'm going to try deploying and see if that helps.. — greylock
OK! It finds it on the app, just not the dev-server. Does that help anyone figure out what's going wrong? — greylock
The result from ` os.environ.get('BUCKET_NAME', app_identity.get_default_gcs_bucket_name())` is never used, as you always return app_identity.get_default_gcs_bucket_name() . Did you update your code? — A.Queue
I have edited my answer. I inadvertently directed you to the idiomatic library that currently doesn't support GAE Standard. Now I share with you a different example for the same tutorial. — A.Queue

gaefan gaefan · Accepted Answer · 2018-03-08T14:49:06

I believe the problem relates to permissions. The app on the dev server has a different name than the deployed app. The deployed app has a name like s~myappname. The app on the dev server will have a name like dev~myappname or sometimes dev~None.

When your dev server goes to cloud storage to get the file, cloud storage does not recognize the dev server as the owner of that bucket and refuses to provide the file.

To test this, you could make the file on Google Cloud Storage publicly available. If the dev server works afterwards, that was the problem.

Other than making the file publicly available, I'm not sure how to share the file with the dev server. Google's sharing of things between projects is confusing, but you might be able to accomplish it.

App Engine Standard Python Cloud Storage File Not Found

2 Answers