I think this is the point of the Attention portion in an llm, to use context to skew the embedding result closer to what youre looking for. It does seem a litt

I think this is the point of the Attention portion in an llm, to use context to skew the embedding result closer to what youre looking for. It does seem a little strange 'ruler' would be closer to 'king' versus something like 'crown'.