3 ms·

Ask HN: Self-hosting LLMs, is it worth the setup?

1 points by sb13 2y ago

With the advent of DeepSeek, I was thinking if I should consider self-hosting open source LLMs vs using OpenAI APIs. Who here has done this already? And what are your main reasons, privacy or cost?

8thcross 2y ago
people have been doing this for a while now? cost is one factor obviously, but privacy, security, and offline use comes to mind.
- sb13 2y ago
  I was thinking more about them in my cloud environment. Was it easy to setup and maintain for you?
deleted 2y ago
[deleted]