Update: here is a patched llama.cpp and quantized model for desktop use: https://github.com/solwyc/talkie-1930-13b-it-q5 https://github.com/solwyc/talkie-1930-1

Update: here is a patched llama.cpp and quantized model for desktop use: https://github.com/solwyc/talkie-1930-13b-it-q5 https://github.com/solwyc/talkie-1930-13b-it-q5