At least to the per-machine monitoring within an app service: If you go to the "diagnostics and services" options, then "diagnostics as a service" there's some

At least to the per-machine monitoring within an app service: If you go to the "diagnostics and services" options, then "diagnostics as a service" there's something where you'll see "app services" on the right side (I'm trying to recall all this from memory so forgive if I've transposed some words in the names) and it will give you the perf counter breakdown per node. I'll give you absolutely un-intuitive UI, but maybe that can at least be helpful. (Disclosure, MS dev for an unrelated team, I just know these bits since I was using them recently)