4 ms·

Is this k8s for LLMs?

• CaptainOfCoit 2y ago
  The submitted project is a framework for building programs. Kubernetes is a platform for deploying and running applications. So no.
• cheesyFish 2y ago
  Not quite. More like a framework to make LLMs/agents easier to deploy in a distributed fashion. We have a PR that shows how to deploy this with k8s!