3 ms·
Many models that use test time compute are MoEs, but test-time compute is generally meant to refer to reasoning about the prompt/problem the model is given, not
by oofbaroomf 1y ago
Many models that use test time compute are MoEs, but test-time compute is generally meant to refer to reasoning about the prompt/problem the model is given, not about reasoning about which model to pick, and I don't think anyone has released an LLM router under that name.
- retinaros 1y agowe dont know what OAI does to find the best answer when reasoning but I am pretty sure that having variations of a same model is part of it.