3 ms·
When I tried local llama for this (on a computer), it used tons of battery and memory; I guess it would be hard to use that on mobile device; they probably need
by karel-3d 1y ago
When I tried local llama for this (on a computer), it used tons of battery and memory; I guess it would be hard to use that on mobile device; they probably need to do a lot of work to make it feasible on iOS and locally and it just sucks.
On the positive side, I don't feel bad for having iPhone without Apple Intelligence.