treis

7 ms·

121.
by treis 4mo ago
They don't shut up about it. Profitable on inference has been the story for years.
122.
by treis 4mo ago
The pricing on Open router is clear. Anthropic, OpenAI, and Google all garner a massive premium over deepseek and qwen. There's no other realistic explanation except that they're making bank.
123.
by treis 4mo ago
>What happens in a few years when DeepSeek runs on the chinese chips like the Huawei Ascend at a fraction of the cost ? Nvidia goes back to being a 100 billion dollar business and everyone else reaps the benefits of cheap tokens.
124.
by treis 4mo ago
They're not any sort of bag holder. They're going to make back what they spent on these data centers in a year. It's a fairly sweet deal for everyone involved. Anthropic/Google get to sell more tokens and xAI gets a war
125.
by treis 4mo ago
There's no realistic way for the music to stop. The demand for LLMs is staggering and the big providers are charging full freight for inference. They might not make back the money from training but these data centers are definitely g
126.
by treis 4mo ago
An amusing thought but I mean the potato salad deli stuff. Anything prepared on site (in a store or restaurant) doesn't need to disclose ingredients. There's no special exception for bread.
127.
by treis 4mo ago
Food as a % of income declined dramatically. This chart has it at 18% in 1960 declining to ~10% today. https://www.ers.usda.gov/amber-waves/2020/november/average-s... There were a ton of programs after WWII
128.
by treis 4mo ago
All fresh food does not have to disclose ingredients
129.
by treis 4mo ago
The value is not going down. The cost is.
130.
by treis 4mo ago
Relative to the current usage demand for tokens is effectively unlimited. If the price of tokens go down people will send more tokens to compensate. We are very very far away from a cost per token where people run out of things they want to
131.
by treis 4mo ago
I used to boot from a USB stick
132.
by treis 4mo ago
There's models for every price point. What was SOTA and stupid expensive to run a year ago is a cheap flash model today.
133.
by treis 4mo ago
I don't see it. Leasing equipment and paying per seat license fees makes a lot of accounting and cash flow sense. Maybe when it gets to the point where you can run SOTA LLMs on consumer hardware. But that seems a solid decade and pro
134.
by treis 4mo ago
Llama?
135.
by treis 4mo ago
They don't have to be as cynical as the internets are these days. It's perfectly normal to take pride that half the phones in the world run software you wrote or that you've solved whatever problem for people.
136.
by treis 4mo ago
ChatGPT has like a billion weekly users that are giving them a massive amount of data. Everyone is going to want to advertise with them. Enterprise isn't slamming the breaks on spending. At worst they've transitioned from spendi
137.
by treis 4mo ago
Of course they can. They're going to sell ads and subscriptions. Both of which are going to make bank. That their service is wildly oversubscribed and hence expensive is not an indication that they're in economic trouble.
138.
by treis 4mo ago
I don't think it's really that misleading. You're buying a license and I'm hard pressed to think of some other interpretation of that. That the license kind of sucks and comes with restrictions is the bigger problem tha
139.
by treis 4mo ago
Everybody talks about this stuff all the time
140.
by treis 4mo ago
That's pretty far away from where we're at. If things do get that far it's not going to be a problem. Eventually the robots will murder us in our sleep and our worries will be over.
141.
by treis 4mo ago
ChatGPT still says walk but adds: >The main reasons to drive such a short distance would be if you're bringing the car specifically to be washed, carrying something heavy, or the weather or walking conditions make it impractical. &g
142.
by treis 4mo ago
Could you have predicted in 1920 that in 2020 that 48% of the country would stop farming and some would be programmers?
143.
by treis 4mo ago
There's not going to be much additional poor unemployed people. They're going to get different jobs.
144.
by treis 4mo ago
Enough that it's effectively infinite, yes. Especially if we are imagining a world where subways cost 1/20th of what they do today.
145.
by treis 4mo ago
Demand and primary resources are effectively infinite.
146.
by treis 4mo ago
What is?
147.
by treis 4mo ago
>The construction worker it replaces isn't going to start managing a team of robots construction robots Some of them will. You've slashed construction labor cost to 5% of what it was before. With that and a similar reduction
148.
by treis 4mo ago
Obviously I'm not immune from the anxiety everyone feels and it's going to be bad for some people. That doesn't change that historically the jobs aren't from programmer to cashier. They're from shoveling shit or s
149.
by treis 4mo ago
This isn't how the economy works at all. We're not all unemployed because farms mechanized. We're not all unemployed because factories automated. We won't all be unemployed if AI takes over white collar work.
150.
by treis 4mo ago
This tracks and IMHO some of the disconnect between technology innovation and productivity is that engineers are soaking up the excess by working less. They're not banging out more code/functionality because by and large that isn

More ›