3 ms·
I disagree. Self-hosting has always have a lot of drawbacks compared with commercial solutions. I bet my self-host file server has worse reliability than Googl
by mrheosuper 1y ago
I disagree.
Self-hosting has always have a lot of drawbacks compared with commercial solutions. I bet my self-host file server has worse reliability than Google Drive, or my self-host git server has worse number of concurrent user than github.
It's one thing you must accept when self-host.
So when you self-host LLM, you must either accept a drop in output quality, or spend a small fortune on hardware
- deleted 1y ago[deleted]
- kortilla 1y agoThose aren’t good analogies because it costs nearly nothing to make that availability tradeoff and run things on your computer for your own fun. Raspberry pi was a huge step forward, the move to LLMs is two steps back.