Google Dataflow workflow error

2
votes

I am trying to run a preprocessing task using Google Dataflow on Cloud-ML. I am getting the following error

Workflow failed. Causes: (c70954cc80d0504c): One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions

Please help me with this.

Thanks, Srini.

1
google-cloud-dataflow
Can you provide more information? What is your stagingLocation set to? What arguments is the job being run with? - Idrees Khan
Thanks for the response Idrees. So my staging location is set to the bucket location gs://<BucketName>. I am pasting the relevant job log from dataflow web interface, to get a deeper context of the exception I am getting: (46c3b12a44f5a2db): Staged package cloudml-0.1.9-alpha.tar.gz at location 'gs://dataflow-sct-ml/flowers__20170223_170110/preproc/temp/flowers-20170223-170112.1487869273.754931/cloudml-0.1.9-alpha.tar.gz' is inaccessible. - Srinivas Thandu

1 Answers

0
votes

This seems to indicate that the bucket you're using isn't configured to be accessible from the project on which you are running the job. It is suggested that you use a bucket owned by the same project on which you run the job. For more guidance, see: