gcloud ml-engine IOError: file does not exist

Question

My jobs in gcloud ml-engine crash because the train file doesn't exist. In the screenshot you can see the error in the top line. At the bottom I check the contents of the directory and the file is clearly there.

error screenshot

source

Answer 1

Pandas does not have native GCS support. If the pandas method you are using accepts file object, then you can use the TensorFlow file_io library to open the file. See the detailed answer here. If not, then you can copy the file to VM first using gsutil cli.