3 ms·
>So why would I want to switch to even worse model? There would be no reason to if you are in the privileged position where cost isn't an issue. For the rest
by Cookingboy 2mo ago
>So why would I want to switch to even worse model?
There would be no reason to if you are in the privileged position where cost isn't an issue.
For the rest of us something that's 95% as good for 20% the price is a hell of a value proposition.
- esafak 2mo agoThat's why every benchmark should show the Pareto frontier against cost and latency.
- FuckButtons 2mo agoPareto optimal dominant vs a human for the same task, not an unreasonable framing but that assumes that it can actually do the task, which the op was arguing it couldn’t at all. Which, I suppose you could model as the utility of task completion % as being non linear. I have heard many people argue that the nature of work is messy and complicated and many things they do could not easily be emulated or automated. I do wonder how many of those activities are actually something that are connected to a companies ability to generate revenue or are just the messy interactions between people.
- kadushka 2mo agoCost is absolutely an issue here - my time is worth approximately $1000/day, so if a slightly worse model wastes one more hour of my time a day than the best model, it costs the company >$2k/mo. Fortunately my employer understands this well and encourages me to use the best models as much as I can.
- surgical_fire 2mo agoThis reply must have cost dozens of dollars.
- ThunderSizzle 2mo agoThis must be the new linked in strat. What I learned about using the best model after talking to a homeless person.
- firmretention 2mo agoImagine how much it must have cost to have him read your comment! I hope he sends you an invoice.
- Cookingboy 2mo agoThat’s the thing, the difference is so small that you won’t be wasting an hour per day with a model that’s 95% as good. In fact, you’d notice zero difference most of the days and when you do, maybe it’s an extra 30 minutes. And the price difference is far greater than $2k/month once the API cost is no longer subsidized. Would your employer be paying an extra $20k/month to Anthropic if it can save you 2 hours a month?
- casey2 2mo agoImagine if we had this attitude for electricity. No point building a grid, just give it to a few factories that need all day lighting.