4 ms·
If it's costly to run, maybe it's reasonable to expect that persisting settings, which is also costly, has some level of gatekeeping? I'm as ambivalent about LL
by cholantesh 2y ago
If it's costly to run, maybe it's reasonable to expect that persisting settings, which is also costly, has some level of gatekeeping? I'm as ambivalent about LLMs as the next guy, but these are frankly nonsense concerns.
- rufffered 2y agoEither you are confused or maybe I am? The ‘costly’ bit is referring to when asking for a SELECT statement instead of just receiving the SELECT statement I am given pages of overly verbose flowery text, reminders, and custom generated flow chart diagrams. My understanding is most of these things charge per token so I am assuming generating more tokens incurs more costs, and I’m saying it’s generating needless tokens that frustrate me, so cui bono these additional costs? Also more token generation means more energy resources consumed, so it’s burning the planet to frustrate someone it is trying to convince to become a paying customer. How are these nonsense concerns? It is unnecessary to persist any settings if I can just click a “just answer the question” checkbox before clicking send on the prompt.