4 ms·
While this is true, I don't think we are there yet with AI since its usually more expensive to run AI models than it is to perform more traditional statistical
by asdff 3y ago
While this is true, I don't think we are there yet with AI since its usually more expensive to run AI models than it is to perform more traditional statistical modelling.
- deleted 3y ago[deleted]
- matthewdgreen 3y agoA text recognition and face/object recognition model runs on my iPhone every night. A small LLM is used for autocorrect. Current high-end smartphones have more than enough RAM and compute to run pretty sophiscated 7B-param quantized LLMs. This level of capability will find its way down to even entry-level Walmart phones in about five years. Server side, things are going to be even cheaper.
- xcv123 3y ago> usually more expensive to run AI models Machine learning inferencing on phones is cheap these days https://apple.fandom.com/wiki/Neural_Engine https://apple.fandom.com/wiki/Neural_Engine