For base tooling, things like: https://huggingface.co/ https://huggingface.co/ (finding models and downloading them) https://github.com/ggerganov/llama.cpp ht

For base tooling, things like: https://huggingface.co/ https://huggingface.co/ (finding models and downloading them) https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp (llama) https://github.com/cmp-nct/ggllm.cpp https://github.com/cmp-nct/ggllm.cpp (falcon) For interactive work (art/chat/research/playing around), things like: https://github.com/oobabooga/text-generation-webui/blob/main/docs/LLaMA-model.md https://github.com/oobabooga/text-generation-webui/blob/main... (llama) (Also - they just added a decent chat server built into llama.cpp the project) https://github.com/invoke-ai/InvokeAI https://github.com/invoke-ai/InvokeAI (stable-diffusion) Plus a bunch of hacked together scripts. Some example models (I'm linking to quantized versions that someone else has made, but the tooling is in the above repos to create them from the published fp16 models) https://huggingface.co/TheBloke/llama-65B-GGML https://huggingface.co/TheBloke/llama-65B-GGML https://huggingface.co/TheBloke/falcon-40b-instruct-GPTQ https://huggingface.co/TheBloke/falcon-40b-instruct-GPTQ https://huggingface.co/TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ https://huggingface.co/TheBloke/Wizard-Vicuna-30B-Uncensored... etc. Hugging face has quite a number, although some require filling out forms for the base models for tuning/training.