3 ms·
I remember to have read somewhere that GPT4 is not a single model but several models whose parameter counts are reported as a single sum. Perhaps quite doable b
by _nalply 3y ago
I remember to have read somewhere that GPT4 is not a single model but several models whose parameter counts are reported as a single sum. Perhaps quite doable but at lower speeds?
- kirill5pol 3y agoThe article linked here talks about GPT4 being a mixture of experts, which is exactly what you’re describing