I've created a scale set agent pool. Managed to set everything, but I can't use it withing azure devops pipelines because it's not listed under Agent Pools. I can't create another Scale Set Agent Pool with the same Scale Set as it detects it being used.
If I check it from az cli:
az pipelines agent list --pool-id 25 -o table
will show all 3 instances up and online.