4 ms·
Radostin from RedHat did some interesting work on hot-swapping (kinda cold-start) of models: https://www.researchgate.net/publication/392759373_Transparent_Hot-
by qnib 1y ago
Radostin from RedHat did some interesting work on hot-swapping (kinda cold-start) of models: https://www.researchgate.net/publication/392759373_Transparent_Hot-Swapping_of_Containerized_AIML_Workloads https://www.researchgate.net/publication/392759373_Transpare...
Definitely something that might be added in the future.