I'll +1 the votes for Guanaco and Vicuna running with the Oobabooga text-generation-webui. With a 4090, you can get ChatGPT 3.5 level results from Guanaco 33B.

I'll +1 the votes for Guanaco and Vicuna running with the Oobabooga text-generation-webui. With a 4090, you can get ChatGPT 3.5 level results from Guanaco 33B. Vicuna 13B is a solid performer on more resource-constrained systems. I'd urge the naysayers who tried the OPT and LLaMA models only to give up to note that the the LLM field is moving very quickly - the current set of models are already vastly superior to the LLaMA models from just two months ago. And there is no sign the progress is slowing - in fact, it seems to be accelerating.