3 ms·

Super interesting! Can you point me to some of the models and repos you used to do this?

• horsawlarway 3y ago
  For base tooling, things like: https://huggingface.co/ https://huggingface.co/ (finding models and downloading them) https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp (llama) https://github.com/cmp-nct/ggllm.cpp https://github.com/cmp-nct/ggllm.cpp (falcon) For interactive work (art/chat/research/playing around), things like: https://github.com/oobabooga/text-generation-webui/blob/main/docs/LLaMA-model.md https://github.com/oobabooga/text-generation-webui/blob/main... (llama) (Also - they just added a decent chat server built into llama.cpp the project) https://github.com/invoke-ai/InvokeAI https://github.com/invoke-ai/InvokeAI (stable-diffusion) Plus a bunch of hacked together scripts. Some example models (I'm linking to quantized versions that someone else has made, but the tooling is in the above repos to create them from the published fp16 models) https://huggingface.co/TheBloke/llama-65B-GGML https://huggingface.co/TheBloke/llama-65B-GGML https://huggingface.co/TheBloke/falcon-40b-instruct-GPTQ https://huggingface.co/TheBloke/falcon-40b-instruct-GPTQ https://huggingface.co/TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ https://huggingface.co/TheBloke/Wizard-Vicuna-30B-Uncensored... etc. Hugging face has quite a number, although some require filling out forms for the base models for tuning/training.
  • xcskier56 3y ago
    Thank you!