Does the Python SDK for Apache Beam have IntraBundleParallelization support like the Java SDK? I realize that the benefit of multithreading in Python is limited, but I was wondering if there were any efforts or plans to add support to do the same with Python.
1 Answers
0
votes
IntraBundleParallelization was removed from Dataflow Java SDK 2.X. https://cloud.google.com/dataflow/release-notes/release-notes-java-2#individual_api_changes
The reason was mentioned in another post: Is there an alternative to IntrabundleParallelization in Dataflow 2.1.0?
It is not likely to be added to Python SDK any time in the future.