In general the default LLM models are too big to run on a consumer GPU without quantization. That means additional steps or alternative downloads are needed.

In general the default LLM models are too big to run on a consumer GPU without quantization. That means additional steps or alternative downloads are needed. Also generative graphics models are about 6 months further advanced than generative text models because Stable Diffusion came out before Llama (Llama being the first "useful" smaller-large-language-model)