4 ms·
> You cannot run a real-time AI system as a single ML pipeline. It consists of at least an offline training pipeline that is run when you train a new version of
by physicsguy 2y ago
> You cannot run a real-time AI system as a single ML pipeline. It consists of at least an offline training pipeline that is run when you train a new version of the model and an online inference pipeline that runs 24/7.
Yeah, this is a big assumption, and one that isn't always true. There are plenty of cases where you want to have data trained only on a sliding window of recent data, and so might train and infer at runtime. It's particularly common if you move stuff down to the edge.
- jamesblonde 2y agoMany data scientists make the assumption that training data is static.
- physicsguy 2y agoWhich is a poor assumption, but that's not my point, it's that even with a pipelining solution you can't assume that you're training a model at intervals in an offline fashion.