0
votes

Got an error message in my dataflow job.

I am using 2.1.0 SDK and cloudshell to launch my job.

(606330f83ab2470f): Workflow failed. Causes: (606330f83ab24c58): The Dataflow appears to be stuck. Please reach out to the Dataflow team at http://stackoverflow.com/questions/tagged/google-cloud-dataflow.

1
Can you share the job ID ?chamikara
2017-11-12_23_05_43-10207672922100781861Utkarsh Sopan

1 Answers

0
votes

Internally, Dataflow failed to create worker instances. The error was :

[...] Invalid value for field 'resource.properties.networkInterfaces[0].subnetwork': ''. Network interface must specify a subnet if the network resource is in custom subnet mode. [..]

Can you provide --subnetwork option while launching the job? (brief description here : https://beam.apache.org/documentation/sdks/javadoc/2.0.0/org/apache/beam/runners/dataflow/options/DataflowPipelineWorkerPoolOptions.html#getSubnetwork--)

It might look like something like "regions/us-central1/subnetworks/your-network-name-us-central1"