2 ms·
>DNNs/LLMs can only predict next tokens based on training data. How do they decide between using 'a' or 'an'?
by Lerc 4mo ago
>DNNs/LLMs can only predict next tokens based on training data.
How do they decide between using 'a' or 'an'?
- alecco 4mo agoThey pick random top-k next token based on their amazing 4chan/reddit training data, duh.
- Lerc 4mo agoSo you you think a model if asked. "There is an animal very similar to a crocodile but I cannot remember it's name" and the model responds with "I believe the animal you are thinking of might be " ("a" / "an") Are you saying that it would pick the result fairly randomly and then based on it's choice pick an animal that starts with a consonant or a vowel?
- falcor84 4mo agoI don't get the argument; how do you decide between using 'a' or 'an'?
- Lerc 4mo agoYou use 'an' when the word that comes after it begins with a vowel.