3 ms·
> Right, but they can (and do) also prepackage ML inference services that don't involve Postgres. but then you would need some dataprocessing/warehousing infra
by riku_iki 3y ago
> Right, but they can (and do) also prepackage ML inference services that don't involve Postgres.
but then you would need some dataprocessing/warehousing infra integrated to produce dataset for inference and then do something with inference results. Having one db with everything packaged would reduce complexity significantly.
ML training workflow also could be integrated into this DB, so you could have few queries to generate data for training, model training, generate data for inference, produce inference results and do something with inference results.
- hot_gril 3y agoI was just looking at inference, meaning you need some separate infra to do the training either way. If the DB does the training too, then yeah. I think we're pretty far from that, and Postgres by itself might not be the platform for it. There are platforms with SQL-like interfaces that use databases underneath, but there's a lot happening on top.
- riku_iki 3y agoI think it is all few months work project, given you can run any arbitrary py/c code in extension in postgres, so it is a matter of data wrangling: convert pg table to recordio, run train/inference, convert results back to pg table, wrap logic into pg/py or pg/c functions.
- tarasglek 3y agoPostgresml.org extension can do training. End to end ml workflows within postgres... Posting this as a happy user.