4 ms·
>you might sometimes prefer a smaller one because being able to do something in real-time, or being able to run on a mobile device, is more important than margi
by bredren 1y ago
>you might sometimes prefer a smaller one because being able to do something in real-time, or being able to run on a mobile device, is more important than marginal accuracy gains for some applications.
This reminds me of ~”the best camera is the one you have with you” idea.
Though, large models are an http request away, there are plenty of reasons to want to run one locally. Not the least of which is getting useful results in the absence of internet.