3 ms·
> At some point these local models will get good enough for ‘real work’ Are these small models good enough for anything but autocomplete?
by koakuma-chan 1y ago
> At some point these local models will get good enough for ‘real work’
Are these small models good enough for anything but autocomplete?
- _heimdall 1y agoIsn't that all they're designed for? They predict more than just the second half of a word you are typing, but at the end of the day they're still just predicting what a human would have typed.
- koakuma-chan 1y agoI'm disappointed because I don't use autocomplete.
- MangoToupe 1y agoGiven that's 99% of my usage of it, that alone would make me quite happy.
- Eggpants 1y agoMost of the "magic" of large models are really just function calls, so as long as the small models have access to the same functions they work well. They fixed the "how many R's in Strawberry" issue by offloading the question to a function, not spending a godly amount of money/energy on training another model. Oops, sorry "Tools". Gotta maintain the grift these statistic based lossy text compression cool bar tricks are "thinking".