4 ms·
> the models I do use remain static and predictable Some people overload "local" a bit to mean you are hosting the model - whether it's on your computer, on yo
by jasonjmcghee 1y ago
> the models I do use remain static and predictable
Some people overload "local" a bit to mean you are hosting the model - whether it's on your computer, on your rack, or on your hetzner instance etc.
But I think parent is referring to the open/static aspect of the models.
If it's hosted by a generic model provider that is serving many users in parallel to reduce the end cost to the user, it's also theoretically a static version of the model... But I could see ad-supported fine tunes being a real problem.
- deleted 1y ago[deleted]
- throwanem 1y agoI am bewildered to hear the sense of "local," in which I and engineers in my experience have for thirty years referred to things which are not remotely hosted, referred to as an "overload."
- haolez 1y agoMy definition of local is the same as yours. It's just that my mind got focused on the open models part and I forgot that you specifically mentioned a "local" setup. My bad
- jasonjmcghee 1y agoI thought it was friendlier than "abuse"
- throwanem 1y agoLess absurd, anyway. In what sense does one "abuse" a word to use it in its dictionary definition? You appear to be a good example of where this benighted excuse for an industry is headed. Explain it to me.