2 ms·

Consider it a low level routing. Keeping in mind it allows the other non active parts to not be in memory. Mistral afaik came up with this concept, quite a whil

by hirako2000 1y ago

Consider it a low level routing. Keeping in mind it allows the other non active parts to not be in memory. Mistral afaik came up with this concept, quite a while back.

ItsHarper 1y ago
It's actually just a high-level routing between the reasoning and non-reasoning models that only applies to ChatGPT.