3 ms·
You have a very curious definition of "local" if that includes "cloud-based providers".
by egypturnash 1y ago
You have a very curious definition of "local" if that includes "cloud-based providers".
- jasonjmcghee 1y ago> the models I do use remain static and predictable Some people overload "local" a bit to mean you are hosting the model - whether it's on your computer, on your rack, or on your hetzner instance etc. But I think parent is referring to the open/static aspect of the models. If it's hosted by a generic model provider that is serving many users in parallel to reduce the end cost to the user, it's also theoretically a static version of the model... But I could see ad-supported fine tunes being a real problem.
- deleted 1y ago[deleted]
- throwanem 1y agoI am bewildered to hear the sense of "local," in which I and engineers in my experience have for thirty years referred to things which are not remotely hosted, referred to as an "overload."
- haolez 1y agoMy definition of local is the same as yours. It's just that my mind got focused on the open models part and I forgot that you specifically mentioned a "local" setup. My bad
- jasonjmcghee 1y agoI thought it was friendlier than "abuse"
- throwanem 1y agoLess absurd, anyway. In what sense does one "abuse" a word to use it in its dictionary definition? You appear to be a good example of where this benighted excuse for an industry is headed. Explain it to me.
- waynecochran 1y agoI assume this means, for example, using their own AWS / EC2 instances to store and process -- not "local" geographically, but "local" personally.
- throwanem 1y agoIt's a two-year-old Mac Studio in the other room. Where are you coming by this novel sense of 'local?'