2 ms·
Agreed, but the kind of stuff I want it to be capable of is way more limited than I'd ask of ChatGPT. I've tried a little model on my iPhone (Llama-3.2-3B-Inst
by rootusrootus 2y ago
Agreed, but the kind of stuff I want it to be capable of is way more limited than I'd ask of ChatGPT. I've tried a little model on my iPhone (Llama-3.2-3B-Instruct) that was better than I expected, both in capability and in responsiveness. Gives me hope for the future of on-device processing.