3 ms·
The whole article hinges on them adding more inference power to the Neural Engine, but the is no benifit or plausable reason to burn weights into ROM.
by ZiiS 2y ago
The whole article hinges on them adding more inference power to the Neural Engine, but the is no benifit or plausable reason to burn weights into ROM.
- Jam-O 2y agoiPhone/iPad 16GB RAM + 64GB hardware local LLM ROM. Apple can phrase it as both a benefit and a reason to upgrade and reduce its costs over suddenly bumping RAM by 400%.
- JumpCrisscross 2y agoOut of all the hardware manufacturers, Apple is the worst candidate to pin planned obsolescence on. Its devices are supported longer than its competitors, and they get better at lasting longer over the years.
- wmf 2y agoI don't know if mask ROM even exists any more or what its density would be. Realistically your choices are DRAM or flash and flash will probably never be fast enough to hold model weights. The toolbox ROM was a great hack in 1984 though.