5 ms·
iPad Mini’s (and iPhone’s) 8gb memory will be very limiting. It’s sufficient for 3b models quantized to 4bits, but puts significantly more powerful 8b models ju
by ed 2y ago
iPad Mini’s (and iPhone’s) 8gb memory will be very limiting. It’s sufficient for 3b models quantized to 4bits, but puts significantly more powerful 8b models just out of reach.
This isn’t a huge issue now, but with another 12 months of local AI progress it’ll leave a competitive opening for device-makers who ship more memory. (See Meta’s TPO paper for significant improvements to Llama, pending release.)
I skipped this iPhone cycle despite being on Apple’s iPhone upgrade program — a memory bump to the Pro line would’ve easily justified an upgrade.