This is how they work and it's a real problem when doing prediction with low temperatures. IIRC you see weird patterns in LLM outputs since "an" is often less

This is how they work and it's a real problem when doing prediction with low temperatures. IIRC you see weird patterns in LLM outputs since "an" is often less likely than "a" so you end up with fewer nouns beginning with vowels than you would expect.