2 ms·
There are open ai compatible chat/completion endpoints for local LLMs. You point the url to your self hosted version, and use the API key you started it with...
by Tostino 3y ago
There are open ai compatible chat/completion endpoints for local LLMs. You point the url to your self hosted version, and use the API key you started it with...