Give the following yarn-session command:
yarn-session.sh -d -n 12 -tm 4096 -qu QueueX -s 4 -jm 2048
We specify the memory for the task manager as 4096, and also we specify the number of slots for each task manager as 4. and throughly 1/4 of task manager's memory is allocated to each task slot.
Then, what about the CPU cores?
Can we specify the number of cores for each task manager?(By default, each yarn container will only has one core). And further, can we specify the number of cores for each task slot?
If we don't specify the number of cores, how many cores each task manager / task slot will use.