5 ms·

Search "mixture of experts" on Google, some unverified leaks say GPT4 is using it already.

• tarruda 3y ago
  Can you share where you read about these leaks?
  • isaacfung 3y ago
    It was all over hackernews. Just google "hacker news gpt4 mixture of experts".
  • brandall10 3y ago
    George Hotz was the first to mention on Lex Fridman’s podcast, and there have been several others close to OpenAI who confirmed.