3 ms·
The architectural problems I deal with day in day out leave no room for atrophy. This is just cope.
by hparadiz 6mo ago
The architectural problems I deal with day in day out leave no room for atrophy. This is just cope.
- platevoltage 6mo agoYou're going to see major cope once that bargain $200/month plan goes away, and every person or company that has embedded these services into their workflows gets to see their actual costs.
- hparadiz 6mo agoHave you actually tried this stuff or are you just saying stuff you hear on the internet?
- platevoltage 6mo agoYes. I have tried this stuff. I really don't see how my use, or non-use of AI APIs changes this reality. Github Copilot announced it's going to per-token pricing in less than a month. I heard that on the internet by the way.
- hparadiz 6mo agoI'm watching people host models on things like LangSmith and OpenRouter for a fraction of the cost you are talking about. We have other people reporting their M4 Macs providing them with performance close to what they get with ChatGPT and Claude all locally with just a 24 GB M4 Mac. We already spend money on laptops. I can put in a ticket for an M4 Macbook Pro from IT right now.
- platevoltage 6mo agoFantastic. I run local models too. This was specifically about APIs
- hparadiz 6mo agoWhy do you think costs will go up when the competition is increasing while hardware prices per compute cycle go down? That's the part I don't get.
- platevoltage 6mo agoGoing from a fixed monthly fee to a per token billing structure is not a cost reduction, and we are watching that happen in real time.