2 ms·
There is one now: https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_K_M/tree/main https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_...
by ranger_danger 6mo ago
There is one now: https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_K_M/tree/main https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_...
- dTal 6mo ago404
- ranger_danger 6mo agoLooks like it was deleted, here is another https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/main https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/ma... After downloading, it looks like it uses a custom "talkie" model architecture that is not supported at least by llama.cpp. Edit: This one has now been deleted as well for some reason...
- ranger_danger 6mo agoUpdate: here is a patched llama.cpp and quantized model for desktop use: https://github.com/solwyc/talkie-1930-13b-it-q5 https://github.com/solwyc/talkie-1930-13b-it-q5