3 ms·
> it's too slow to be useful with such specs. Only if you insist on realtime output: if you're OK with posting your question to the model and letting it run ov
by zozbot234 2y ago
> it's too slow to be useful with such specs.
Only if you insist on realtime output: if you're OK with posting your question to the model and letting it run overnight (or, for some shorter questions, over your lunch break) it's great. I believe that this use case can fit local-AI especially well.