32 ms·
The 1T number is wild hype. It's likely GPT4 is actually a mixture-of-experts with smaller models under the hood.
by ukuina 3y ago
The 1T number is wild hype. It's likely GPT4 is actually a mixture-of-experts with smaller models under the hood.