4 ms·
On my Android device works pretty fast. But keep in mind that it's small Llama-3.2-1B model, specially for less powerfull GPU.
by andreinwald 1y ago
On my Android device works pretty fast.
But keep in mind that it's small Llama-3.2-1B model, specially for less powerfull GPU.