3 ms·
Who's paying the $50k? I don't see how it makes sense to pay that much for a home-grown setup when I could pay <$5k/year total for both of the two best frontier
by rsanek 4mo ago
Who's paying the $50k? I don't see how it makes sense to pay that much for a home-grown setup when I could pay <$5k/year total for both of the two best frontier models at effectively unlimited usage.
- fragmede 4mo ago> best frontier models at effectively unlimited usage. It would've been easy to spend $5k on Fable in the short week it was available. If that's the direction things are going (we can assume GPT-6 to be if similar class) $5k's not going to get you "best frontier models at effectively unlimited usage".
- angry_octet 4mo agoI know some orgs that are already spending more on tokens than developer salary. That's what unlimited use leads to. Teams of agents running on expensive models, agents designing and running test suites with barely any oversight.
- angry_octet 4mo agoThis is for clients paying millions for deliverables, with high stakes deadlines. Expertise in the domain is in short supply. Data and model control is very important, so relying on AIaaS was already risky. You can LLM enable engineers without big AIaaS risks. A 16C Ryzen 128GB with 96GB Blackwell is ~US$16k, quite reasonable for a worker billed at $300k. In fact so reasonable it's worth having AI enabled backend for lots of things.
- Epicism 4mo ago$5k? I work at a software company where one engineer has used that every month minimum.