I'm currently using Azure hosted build agents on Visual Studio Team Services. Now, I've installed a build agent on-premise and successfully configure it to run as part of the Default agent pool. I can also change my projects to use the Default agent pool and everything works as expected.
My question is this: is it possible to configure a project or agent pool to contain build agents from both on-premise and Azure hosted? I would like VSTS to pick my on-premise build agent first (and if available). If a build is already running on this agent or if it is not available, I would like VSTS to pick a build agent hosted on Azure. This way, I can run most builds on-premise, but utilize Azure if I run out of build slots locally or if my server is unavailable.