4 ms·

Specifically including routing (i.e. which model you route to based on load/ToD)? PS - I appreciate you coming here and commenting!

• hhh 9mo ago
  There is no routing with API, or when you choose a specific model in chatGPT.
  • deleted 9mo ago
    [deleted]
  • zwaps 9mo ago
    In the past it seemed there was routing based on context-length. So the model was always the same, but optimized for different lengths. Is this still the case?