Isn't this why benchmarking is used? You select some common payload and then use that as a realworld simulation of how your architecture performs with it. Of c

Isn't this why benchmarking is used? You select some common payload and then use that as a realworld simulation of how your architecture performs with it. Of course this comes with its own can of worms, like overfitting and such, but I could imagine a benchmarking solution that gives you a more granular look at which specific tasks an architecture performs well.