3 ms·
Name them like clothing sizes: XXLLM, XLLM, LLM, MLM, SLM, XSLM XXSLM.
by latexr 2y ago
Name them like clothing sizes: XXLLM, XLLM, LLM, MLM, SLM, XSLM XXSLM.
- ai-christianson 2y agoMLM... uh oh
- anonym29 2y agoI hate those ponzi schemes! Never buy a cutco knife or those crappy herbalife supplements. Alternatively, just make sure you keep things consensual, and keep yourself safe, no judgement or labels from me :)
- deleted 2y ago[deleted]
- swyx 2y agoi did this! XXLLM: ~1T (GPT4/4.5, Claude Opus, Gemini Pro) XLLM: 300~500B (4o, o1, Sonnet) LLM: 20~200B (4o, GPT3, Claude, Llama 3 70B, Gemma 27B) ~~zone of emergence~~ MLM: 7~14B (4o-mini, Claude Haiku, T5, LLaMA, MPT) SLM: 1~3B (GPT2, Replit, Phi, Dall-E) ~~zone of generality~~ XSLM: <1B (Stable Diffusion, BERT) 4XSLM: <100M (TinyStories) https://x.com/swyx/status/1679241722709311490 https://x.com/swyx/status/1679241722709311490