An obvious thing to do is that if you have enough concurrent batches to max out performance you should use those and not speculate. But if compute would be idl

An obvious thing to do is that if you have enough concurrent batches to max out performance you should use those and not speculate. But if compute would be idle waiting on memory, fill the excess with speculation.