3 ms·
how many times do you have to be metaphorically hit in the head with a brick before you realize inference margins at api pricing were 80%+
by anthonypasq 2mo ago
how many times do you have to be metaphorically hit in the head with a brick before you realize inference margins at api pricing were 80%+
- brazukadev 2mo agoI was metaphorically hit in the head with the brick of already provisioned computing with a lot less demand than anticipated by multiple MoUs.
- svieira 2mo agoSo, does that mean they're selling tokens at cost? Or that they realized they were doing 180% more work than necessary and they're passing the savings on because "your margin is my opportunity" and this is a dog-eat-dog fight, but 80% margins are nice, no one needs multiple hundreds?
- simianwords 2mo agoI genuinely don’t get why you will not accept the simplest explanation? They found efficiencies? Why all these contrived explanations??
- dgellow 2mo agoUh… are you okay? That’s a completely disproportionate, aggressive tone. How is that warranted
- simianwords 2mo agoDisproportionate yes but you seem still confused on how it’s economically possible when 1. The basic mechanism is literally described in the post: they found efficiencies and passed it down 2. This has been the trend for all the time LLMs have existed Why confusion then? What’s surprising you?