4 ms·
Basically equivalent to GitHub but for models. Anyone can upload anything, but it kind of standardizes tools and distribution for everyone. They also have a tea
by jerpint 2y ago
Basically equivalent to GitHub but for models. Anyone can upload anything, but it kind of standardizes tools and distribution for everyone. They also have a team that helps integrate releases for easier use and libraries for fine tuning
- profsummergig 2y agoThanks! I want to download my first HuggingFace model, and play with it. If you know of a resource that can help me decide what to start with, please share. If you don't, no worries. Thanks again.
- hrpnk 2y agoMost of the HF models have a code snippet that you can use in order to run inference on the model. The transformers library will take care of the download as a dependency when you run the code. Typically, a python 3.10-3.11 environment is sufficient as environment. Example: https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct#transformers https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct#t... If you have a MBP, you need to adjust the device name in the examples from "cuda" to "mps".
- int_19h 2y agoIf you're on a Mac, https://lmstudio.ai https://lmstudio.ai is a quick way to get things running with a decent UI and a REST API that is compatible with OpenAI (which is the de facto standard these days). And the GGUF models that it downloads can be used directly via llama.cpp, if you are so inclined later.
- jerpint 2y agoTheir docs are very fun to read. I’d probably recommend starting with the “transformers” library for python if you want to play with some language models e.g. Bert: https://huggingface.co/docs/transformers/en/model_doc/bert https://huggingface.co/docs/transformers/en/model_doc/bert