4 ms·

For me the question is who is going to subscribe who hasnt already. And that is before we consider the next gen hardware that can run this stuff locally. But

For me the question is who is going to subscribe who hasnt already. And that is before we consider the next gen hardware that can run this stuff locally. But from what I see of the economy around me here, people just dont have the spare funds for LLM luxuries. It feels like 15+ years of wage deflation, and company streamlining, has removed what little spare spending power people had here. Not forgetting the inflation we have seen in the euro zone. Even if the bet is now an 'all in' on AGI, I see that more as an existential threat than an economic golden egg bailout.

reaperducer 1y ago
But from what I see of the economy around me here, people just dont have the spare funds for LLM luxuries. If you have to pick between Disney+ for your kids and a chatbot subscription, it's a pretty easy choice. More and more people are making choices like that.
- whimsicalism 1y ago
  for the chatbot, right? can never tell on the orange site..
dzhiurgis 1y ago
IMO they can raise prices 10x and developers will happily continue paying.
marak830 1y ago
"...who is going to subscribe who hasnt already." I think there will be an increase in subscribers as people get more used to them. But there's probably also people like me who just dropped 2k on a new system to self host my own to customise the pipeline, and integrate it into my house without sending data offsite.
- whitehexagon 1y ago
  Nice, what did you settle on? I'm playing with qwen3:32b on an Asahi M1 currently, and it does more than enough for me, but might be tempted if there is a bigger model within reach.
  - marak830 1y ago
    I'm still evaluating at the moment, I'm using a targeted model approach - one for the conversation layer, another for coding etc. Currently working on a memory system to help the model changes, so it's all a bit up in the air for now haha.
- deaux 1y ago
  > But there's probably also people like me who just dropped 2k on a new system to self host my own to customise the pipeline, and integrate it into my house without sending data offsite There's dozens of us I tell you! We're entirely irrelevant in this story. The only thing that would change this is if Apple at some point makes it turnkey to run good models on their hardware. That's it.

reaperducer 1y ago

But from what I see of the economy around me here, people just dont have the spare funds for LLM luxuries. If you have to pick between Disney+ for your kids and a chatbot subscription, it's a pretty easy choice. More and more people are making choices like that.

whimsicalism 1y ago
for the chatbot, right? can never tell on the orange site..

dzhiurgis 1y ago

IMO they can raise prices 10x and developers will happily continue paying.

marak830 1y ago

"...who is going to subscribe who hasnt already." I think there will be an increase in subscribers as people get more used to them. But there's probably also people like me who just dropped 2k on a new system to self host my own to customise the pipeline, and integrate it into my house without sending data offsite.

whitehexagon 1y ago
Nice, what did you settle on? I'm playing with qwen3:32b on an Asahi M1 currently, and it does more than enough for me, but might be tempted if there is a bigger model within reach.
- marak830 1y ago
  I'm still evaluating at the moment, I'm using a targeted model approach - one for the conversation layer, another for coding etc. Currently working on a memory system to help the model changes, so it's all a bit up in the air for now haha.
deaux 1y ago
> But there's probably also people like me who just dropped 2k on a new system to self host my own to customise the pipeline, and integrate it into my house without sending data offsite There's dozens of us I tell you! We're entirely irrelevant in this story. The only thing that would change this is if Apple at some point makes it turnkey to run good models on their hardware. That's it.