0
votes

Does the Python SDK for Apache Beam have IntraBundleParallelization support like the Java SDK? I realize that the benefit of multithreading in Python is limited, but I was wondering if there were any efforts or plans to add support to do the same with Python.

1

1 Answers

0
votes

IntraBundleParallelization was removed from Dataflow Java SDK 2.X. https://cloud.google.com/dataflow/release-notes/release-notes-java-2#individual_api_changes

The reason was mentioned in another post: Is there an alternative to IntrabundleParallelization in Dataflow 2.1.0?

It is not likely to be added to Python SDK any time in the future.