5 ms·
This is damn near prescient, I'm having a hard time believing it was written in 2021. He did get this part wrong though, we ended up calling them 'Mixture of E
by botro 2y ago
This is damn near prescient, I'm having a hard time believing it was written in 2021.
He did get this part wrong though, we ended up calling them 'Mixture of Experts' instead of 'AI bureaucracies'.
- stavros 2y agoI think the bureaucracies part is referring more to Deep Research than to MoE.
- robotresearcher 2y agoWe were calling them 'Mixture of Experts' ~30 years before that. https://ieeexplore.ieee.org/document/6215056 https://ieeexplore.ieee.org/document/6215056