3 ms·
Honestly the one on my phone is more for fun than anything else - I use it to show people that LLMs can run on personal devices but rarely do anything useful wi
by simonw 2y ago
Honestly the one on my phone is more for fun than anything else - I use it to show people that LLMs can run on personal devices but rarely do anything useful with it.
I use the MLC Chat app from the App Store: https://apps.apple.com/gb/app/mlc-chat/id6448482937 https://apps.apple.com/gb/app/mlc-chat/id6448482937
My favourite example prompt for demos is "Write an outline of a Netflix Christmas movie where a topical-profession falls in love with another topical-profession" - customized for the occasion.
e.g. "Write an outline for a Netflix Christmas movie set in San Gregorio California about a man who runs an unlicensed cemetery falling in love with a barrister at the general store" - result here: https://bsky.app/profile/simonwillison.net/post/3ldthrqb6c22q https://bsky.app/profile/simonwillison.net/post/3ldthrqb6c22...
- tough 2y agofullmoon is a good FOSS iOS/macOS client for mlx https://fullmoon.app/ https://fullmoon.app/
- simonw 2y agoOh neat, that one has a feature that I am missing from MLC - it logs your conversations and lets you revisit them. Still a bit too hard to copy and paste transcript aback out again though!