3 ms·
Nobody is deploying 3+GB models to iOS beyond some enthusiast “because you can” apps. Amazing tech but not feasible for any mainstream use yet. Eg: https://app
by kiratp 3y ago
Nobody is deploying 3+GB models to iOS beyond some enthusiast “because you can” apps. Amazing tech but not feasible for any mainstream use yet.
Eg: https://apps.apple.com/app/id6444050820 https://apps.apple.com/app/id6444050820
- turnsout 3y agoThe size makes it tough for App Store deployment, but I could imagine using a local LLM on-device for an enterprise app.
- brucethemoose2 3y agoA small download + an in-app weights download (and a space requirement warning) is probably sane, right?
- hustwindmaple1 3y agoIf you have played any large mobile games, then you would not be surprised to see apps downloading massive files during first open.
- refulgentis 3y agoI agree, we're too far down a chain of hypotheticals motivated by "but ONNX must be bad compared to $MODELX.cpp?" Wouldn't make sense to deploy 4-bit quantization as a product either.