3 ms·
This is a read workload that can be easily horizontally scaled. The reduction in dev and infrastructure complexity is well worth the slight increase in DB prov
by CuriouslyC 2y ago
This is a read workload that can be easily horizontally scaled. The reduction in dev and infrastructure complexity is well worth the slight increase in DB provisioning.
- montanalow 2y agoYep, one of our other projects, pgcat is exactly to help make the horizontal scaling as easy as possible. https://github.com/postgresml/pgcat https://github.com/postgresml/pgcat
- nkmnz 2y agoRunning an LLM on the same server as your database is "a read workload that can be easily horizontally scaled"?
- CuriouslyC 2y agoYou can use PL/Python to make API calls outside of the database, you just don't need a separate service to interact with the DB to orchestrate all your ML stuff, only endpoints.