2 ms·
It's RAM. It's absolutely RAM. 3 billion parameters @ 3.5bpp quantization is 1.31GB. And since iOS has no swap it has to be resident in memory alongside everyth
by Veliladon 2y ago
It's RAM. It's absolutely RAM. 3 billion parameters @ 3.5bpp quantization is 1.31GB. And since iOS has no swap it has to be resident in memory alongside everything else the device is running. iPhone 14 Pro only has 6GB of RAM, iPhone 15 Pro has 8GB.
- astrange 2y agoIt's never just one thing but it's partly RAM. They said why somewhere in this interview: https://youtu.be/J7al_Gpolb8 https://youtu.be/J7al_Gpolb8 I like that the article calls the ANE the "Apple Apple Neural Engine".
- BugsJustFindMe 2y ago> I like that the article calls the ANE the "Apple Apple Neural Engine". Even better, they say "Apple introduced the..." I'm pretty sure that makes it Apple's Apple Apple Neural Engine.