I have Azure data lake analytics job that processes around 3.8 million records stored on Azure data lake store using U-SQL user defined operators.
On the first run, I set parallelism equal to 10 and on the second run I used parallelism equal to 1. Surprisingly, my job duration for both execution is same(around 1.5 hours). So it looks like parallelism is not triggered for my job. Is it because I used user defined operators? I am wondering how do I determine when parallelism will be triggered and when it will not?