2 ms·

Yes, Deepseek introduced this optimisation of a common base "expert" that's always loaded. Llama 4 uses it too.

• regularfry 2y ago
  I had a sneaking suspicion that I wouldn't be the first to think of it.