This sub-thread was about cloud environments, where different requests may be served by different hardware. And it's in fact very likely that there will be a mi

This sub-thread was about cloud environments, where different requests may be served by different hardware. And it's in fact very likely that there will be a mix of different hardware from different vendors, in any particular LLM cloud for now.