3 ms·
Running an LLM on the same server as your database is "a read workload that can be easily horizontally scaled"?
by nkmnz 2y ago
Running an LLM on the same server as your database is "a read workload that can be easily horizontally scaled"?
- CuriouslyC 2y agoYou can use PL/Python to make API calls outside of the database, you just don't need a separate service to interact with the DB to orchestrate all your ML stuff, only endpoints.