2 ms·
i guess that means no one should use it for anything serious? good to know
by almostgotcaught 2y ago
i guess that means no one should use it for anything serious? good to know
- Philpax 2y agoTo some extent, yes. I would not run production off of it, even if it can eek out performance gains on hardware at hand. I'd suggest vLLM or TGI or something similar instead.