3 ms·
Could you explain more on how to do this? e.g if I am using the Claude API in my service, how would you suggest I go about setting up and controlling my own inf
by its_down_again 2y ago
Could you explain more on how to do this? e.g if I am using the Claude API in my service, how would you suggest I go about setting up and controlling my own inference endpoint?
- handfuloflight 2y agoYou can't. He means by using the open source models.
- datavirtue 2y agoRuna local LLM tuned for coding on LM Studio. It has a server and provides endpoints.