3 ms·
Question for the crowd -- with autoscaling, when a new pod is created it will still download the model right from huggingface? I like to push everything into t
by apwheele 8mo ago
Question for the crowd -- with autoscaling, when a new pod is created it will still download the model right from huggingface?
I like to push everything into the image as much as I can. So in the image modal, I would run a command to trigger downloading the model. Then in the app just point to the locally downloaded model. So bigger image, but do not need to redownload on start up.
- newzino 8mo ago[flagged]