3 ms·
This one is basically SOTA for AMD, if you can install rocm properly: https://github.com/YellowRoseCx/koboldcpp-rocm https://github.com/YellowRoseCx/koboldcpp-
by brucethemoose2 3y ago
This one is basically SOTA for AMD, if you can install rocm properly:
https://github.com/YellowRoseCx/koboldcpp-rocm https://github.com/YellowRoseCx/koboldcpp-rocm
Some other projects support rocm less explicitly, and not as easily.