4 ms·
I'm guessing its largely enthusiasts for now, but as they continue getting better: 1. App makers can fine tune smaller models and include in their apps to avoi
by azinman2 1y ago
I'm guessing its largely enthusiasts for now, but as they continue getting better:
1. App makers can fine tune smaller models and include in their apps to avoid server costs
2. Privacy-sensitive content can be either filtered out or worked on... I'm using local LLMs to process my health history for example
3. Edge servers can be running these fine tuned for a given task. Flash/lite models by the big guys are effectively like these smaller models already.