4 ms·
Is this just for local inference? We have a server that the team hits via an OpenAI-compatible APIs but serving local models.
by carom 3y ago
Is this just for local inference? We have a server that the team hits via an OpenAI-compatible APIs but serving local models.
- montanalow 3y agoThis is an SDK built to interact with PostgresML, which provides ML & AI _inside_ a Postgres database. Clients in this case don't perform inference, rather the server does. You could run the open source server locally, or connect to one running in the cloud.