Steps to create Cloud Dataflow template using the Python SDK

8
votes

I have created Pipeline in Python using Apache Beam SDK, and Dataflow jobs are running perfectly from command-line.

Now, I'd like to run those jobs from UI. For that i have to create template file for my job. I found steps to create template in Java using maven.

But how do I do it using the Python SDK?

1
google-cloud-dataflowapache-beam
Shipla G, I am have difficulty on this problem as well. Can I view your code anywhere online? Is your code public? I am interested learning from your work - Evan

1 Answers

4
votes

Templates are available for creation in the Dataflow Python SDK since April of 2017. Here is the documentation.

To run a template, no SDK is needed (which is the main problem templates try to solve), so you can run them from the UI, REST API, or CL and here is how.