4 ms·
Is tiny LLM an oxymoron? I believe Apple has told us it’s a transformer language model, but not specifically a LLM.
by KMnO4 3y ago
Is tiny LLM an oxymoron? I believe Apple has told us it’s a transformer language model, but not specifically a LLM.
- catoc 3y agoYeah, they meant a TLM
- 0x1ceb00da 3y agoThat's print('Hello, world!')
- ben_w 3y agoIt's like how the "New Forest" is really old now: even small LLMs are (from what I've seen which isn't exhaustive) large compared to Markov language models.
- astrange 3y agoThere's no difference. An LLM is just a transformer language model that's "large".
- hmottestad 3y agoAccording to this article[1] it has about 34 million parameters. https://jackcook.com/2023/09/08/predictive-text.html https://jackcook.com/2023/09/08/predictive-text.html