I am working on a project that requires to run multiple jobs simultaneously (on different data).
I have a graph with many connected components that have huge sizes. I'm creating new job for every connected component and submitting it. Will these jobs run simultaneously or they will be queued up, and run in a FIFO priority?
Of course I can create only one job and send each connected component to each mapper/reducer but this will cause the program to run slowly, as I am doing heavy computation on each connected component (inversion etc.)