qnib

3 ms·

1. 1.▲
   by qnib 1y ago

   essentially yes. The missing piece is experience in making sure the right files, descriptors and memory blobs are saved and brought back in the right order and the coordination with different schedulers (like K8s in this case, but also AWS
2. 2.▲
   by qnib 1y ago

   Radostin from RedHat did some interesting work on hot-swapping (kinda cold-start) of models: https://www.researchgate.net/publication/392759373_Transpare... Definitely something that might be added in the future.
3. 3.▲
   Show HN: Checkpoint K8s pods transparently (plain CPU or GPU accelerated) [video](youtube.com)

   2 points by qnib 1y ago|4 comments