3 ms·
HuggingFace Is Down
- smcleod 3y agoWas in the middle of testing a PR to hfdownloader and was banging my head against the table trying to figure out what I'd broken... turns out - nothing!
- purrcat259 3y agoI was also in the middle of writing a model downloader and was baffled as to why safetensors headers were suddenly much larger than 8 bytes!
- smcleod 3y agoModel downloaders of the world unite! Here’s my PR ;,) https://github.com/bodaay/HuggingFaceModelDownloader/pull/25 https://github.com/bodaay/HuggingFaceModelDownloader/pull/25
- deleted 3y ago[deleted]
- vinni2 3y ago[flagged]
- ashishb 3y agoAlways build docker images with full models to avoid implicit runtime dependencies. Infact, disable dynamic model downloading from HuggingFace to keep docker builds hermetic. https://ashishb.net/all/hermetic-docker-images-with-hugging-face-machine-learning-models/ https://ashishb.net/all/hermetic-docker-images-with-hugging-...
- vinni2 3y agoThanks for this. Can you explain a bit more? is it like it like it downloads a once and caches or do you need to provide the pre download model s in a volume?
- ashishb 3y agoThe model becomes part of the docker image.
- vinni2 3y agoI get that, but the model needs to be downloaded at least once? Do you download the models as part of the Dockerfile, then?
- ashishb 3y agoYeah
- vinni2 3y agoThanks. I am struggling a bit to login and download the model during GH CI pipeline. I keep getting invalid token error but it works when run locally. Any ideas? Sorry to post this question here.
- ashishb 3y ago> I keep getting invalid token error but it works when run locally. Any ideas? Sorry to post this question here. Invalid token error while executing what?