3 ms·
Yep, we agree that the obvious direction of innovation for OSS models is smaller and cheaper, likely at roughly the same quality: https://generatingconversation
by vsreekanti 3y ago
Yep, we agree that the obvious direction of innovation for OSS models is smaller and cheaper, likely at roughly the same quality: https://generatingconversation.substack.com/p/open-source-llms-shouldnt-try-to https://generatingconversation.substack.com/p/open-source-ll...
- smcleod 3y agoAlso more privacy respecting, and more customisable / flexible.
- wrsh07 3y agoI actually expect open source models will be small _but larger than they are today_ because phones and laptops will get dedicated chips and software for running eg the best open source (weights?) model So eventually you could be running decent sized models locally (iOS could even provide an API with fine tuning etc)