The "invention" was first published in 2024, by Chinese researchers: https://arxiv.org/abs/2402.01030 https://arxiv.org/abs/2402.01030 Beyond that, it's a triv

The "invention" was first published in 2024, by Chinese researchers: https://arxiv.org/abs/2402.01030 https://arxiv.org/abs/2402.01030 Beyond that, it's a trivial batching pattern. Any remotely competent systems engineer developing an agent would immediately reach for it, it's the most basic tool in the toolbox to deal with latency. If Mistral "invested a lot of money in discovering" this, man I'm in the wrong line of work.