Thanks for the reply and the recommendations! I will see if my machine can handle some of the quantized 30B models. I'm slightly confused about your comment ab

Thanks for the reply and the recommendations! I will see if my machine can handle some of the quantized 30B models. I'm slightly confused about your comment about llama.cpp vs oobabooga. Doesn't text-generation-webui use llama.cpp underneath? Also, huge thanks for the point towards https://rentry.org/lmg_models https://rentry.org/lmg_models. That's an invaluable resource.