4 ms·
https://www.runpod.io/console/templates https://www.runpod.io/console/templates This is the readme for the one I mentioned: https://github.com/TheBlokeAI/docke
by spmurrayzzz 3y ago
https://www.runpod.io/console/templates https://www.runpod.io/console/templates
This is the readme for the one I mentioned: https://github.com/TheBlokeAI/dockerLLM/blob/main/README_Runpod_LocalLLMsUIandAPI.md https://github.com/TheBlokeAI/dockerLLM/blob/main/README_Run...
> can I use Colab/Huggingface GPUs?
You use these templates on the runpod platform itself. Theres no free tier equivalent like you have with Colab/HF, but currently you can rent an RTX 4090 for $0.69/hr so its pretty affordable.
- brianjking 3y agoYeah, but I'd like to try deploying this on Huggingface or Lambda Labs. Do you know if that is possible?
- spmurrayzzz 3y agoIn theory yes, since its fundamentally just a Dockerfile, any provider that supports docker is possible. I know HF Spaces have a "docker" sdk option[1], but I personally haven't used them myself. [1] https://huggingface.co/docs/hub/spaces-sdks-docker-first-demo https://huggingface.co/docs/hub/spaces-sdks-docker-first-dem...