4 ms·
This is pure speculation on my part, but the way I think this will play out is something like this: - current CapEx will make the production side increase
by juancn 5mo ago
This is pure speculation on my part, but the way I think this will play out is something like this:
- current CapEx will make the production side increase capacity
- advances in TPUs, NPUs, open weight and quantization will keep going at a rapid pace
- when the spending slows/stops, hardware prices will drop, hard
- most AI workloads will move to the edge (except frontier models) because the hardware is cheaper than a subscription
(and at some point there could be a crash like 2008)
For example, most of my AI use lately has been running Qwen3.6-35B-A3B-UD-Q8_K_XL on a 64GB MacBook Pro with an M3 Max. It runs at ~57 tokens/s and it's mostly fine.
I do use the frontier models a bit, but only when the task is too complex for the local model.
Basic crap, like analyzing an existing codebase and bouncing ideas, making small changes, the local model is enough.