3 ms·
There's no GGUF available, but the process shouldn't be too hard from the provided .ckpt PyTorch checkpoint.
by nateb2022 6mo ago
There's no GGUF available, but the process shouldn't be too hard from the provided .ckpt PyTorch checkpoint.
- ranger_danger 6mo agoThere is one now: https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_K_M/tree/main https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_...
- dTal 6mo ago404
- ranger_danger 6mo agoLooks like it was deleted, here is another https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/main https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/ma... After downloading, it looks like it uses a custom "talkie" model architecture that is not supported at least by llama.cpp. Edit: This one has now been deleted as well for some reason...
- ranger_danger 6mo agoUpdate: here is a patched llama.cpp and quantized model for desktop use: https://github.com/solwyc/talkie-1930-13b-it-q5 https://github.com/solwyc/talkie-1930-13b-it-q5