4 ms·
Given how good Llama 3.1, 3.2 and 3.3 were I'm genuinely looking forward to news on Llama 4. 3.3 70B is the best model I've managed to run on my laptop, and 3.
by simonw 2y ago
Given how good Llama 3.1, 3.2 and 3.3 were I'm genuinely looking forward to news on Llama 4.
3.3 70B is the best model I've managed to run on my laptop, and 3.2 3B is my favourite model to run on my phone.
- cdfuller 2y agoI'd love to hear more about how you're using models on a phone. Have you written anything about it?
- simonw 2y agoHonestly the one on my phone is more for fun than anything else - I use it to show people that LLMs can run on personal devices but rarely do anything useful with it. I use the MLC Chat app from the App Store: https://apps.apple.com/gb/app/mlc-chat/id6448482937 https://apps.apple.com/gb/app/mlc-chat/id6448482937 My favourite example prompt for demos is "Write an outline of a Netflix Christmas movie where a topical-profession falls in love with another topical-profession" - customized for the occasion. e.g. "Write an outline for a Netflix Christmas movie set in San Gregorio California about a man who runs an unlicensed cemetery falling in love with a barrister at the general store" - result here: https://bsky.app/profile/simonwillison.net/post/3ldthrqb6c22q https://bsky.app/profile/simonwillison.net/post/3ldthrqb6c22...
- tough 2y agofullmoon is a good FOSS iOS/macOS client for mlx https://fullmoon.app/ https://fullmoon.app/
- simonw 2y agoOh neat, that one has a feature that I am missing from MLC - it logs your conversations and lets you revisit them. Still a bit too hard to copy and paste transcript aback out again though!