3 ms·

This! And a reminder that Phi1.5 comes in at 2.8GB. Getting a performant model even while using aggressive quantization is going to require more RAM. iPhone

by htrp 2y ago

This! And a reminder that Phi1.5 comes in at 2.8GB. Getting a performant model even while using aggressive quantization is going to require more RAM. iPhone 16 ProAI may end up having notebook levels of ram (12 / 16GB)