4 ms·
To within an order of magnitude that’s probably true. Local llm use is a rounding error at present and likely to remain so outside of specialised application s
by bigfudge 3y ago
To within an order of magnitude that’s probably true. Local llm use is a rounding error at present and likely to remain so outside of specialised application s like scanning. For child porn on your mobile, which you still have no control over.