oobabooga should be king, but it's unstable as hell. ooba's worth keeping an eye on, but koboldcpp is more stable, almost as versatile, and way less frustratin

oobabooga should be king, but it's unstable as hell. ooba's worth keeping an eye on, but koboldcpp is more stable, almost as versatile, and way less frustrating. It also still supports GGML.