3 ms·
obsolescence is the whole point. apple gets to sell a new phone very 6-12 months because of it. i have written about this: "For device makers Packaging model
by try-working 2mo ago
obsolescence is the whole point. apple gets to sell a new phone very 6-12 months because of it.
i have written about this:
"For device makers
Packaging models with laptops and smartphones will let application access near free, low latency inference and potentially offer users a better experience with the option of preserving data on-device. This is viable under the condition that tasks that do require larger expert models that run in the cloud can be routed to external models.
A side-effect of local models and what will let Apple cut upgrade cycles from ~4 years (?) down to 12-18 months is specialized hardware to run them. For almost a decade, smartphones have been trying to compete on better cameras. This coming decade will see them selling better GPUs, NPUs, ASICs and whatever other things they'll be calling the inference chips, to drive re-purchase. Every six months will see a better model on new hardware, which will enable better performance in certain applications."
https://try.works/role-model-the-case-for-a-model-routing-protocol https://try.works/role-model-the-case-for-a-model-routing-pr...
- nomel 2mo agoNo, the point is inference speed and power.
- try-working 2mo agoyou don't understand what I wrote.
- nomel 2mo agoI do. The point is inference speed and power, making previously impossible local inference possible. A side effect of that hardware optimization is fixed capabilities. You've confused engineering compromise for malice, and reversed the purpose. For the model capabilities and inference power draw, what alternative do you see to a (at least mostly) fixed hardware model?
- try-working 2mo agoWhat I'm saying is that Apple will use these type of models etched into chips, and they will do it because it drives obsolescence, so they can shorten the upgrade cycle. They will do it because they figure out it's good for them.
- deleted 2mo ago[deleted]
- nomel 2mo agoYou've confused engineering compromise for malice, and reversed the purpose. For the model capabilities and inference power draw, what alternative do you see to a (at least mostly) fixed hardware model?
- try-working 2mo agoNo, you still don't understand what I'm saying. Yes, ASICs make inference faster, but also makes the hardware obsolete faster, if it's embedded in a phone. That sounds like a negative, but Apple is going to turn it into a positive for their business and use it to speed up upgrade cycles as cameras are no longer a driving factor and cycles have been getting longer.