I was just testing this a bit more. I grabbed qwen3:4b. Cranked it to the max of 32k tokens. It's fast to be sure, and im struggling to get it to hallucinate;

I was just testing this a bit more. I grabbed qwen3:4b. Cranked it to the max of 32k tokens. It's fast to be sure, and im struggling to get it to hallucinate; but it is giving me a ton of 'The provided context does not include specifics' Resource-wise its like running 12-16B, but faster. But soon as you expand the 12B to like 10k tokens it's clearly better for barely anymore resources.