3 ms·
They pick random top-k next token based on their amazing 4chan/reddit training data, duh.
by alecco 4mo ago
They pick random top-k next token based on their amazing 4chan/reddit training data, duh.
- Lerc 4mo agoSo you you think a model if asked. "There is an animal very similar to a crocodile but I cannot remember it's name" and the model responds with "I believe the animal you are thinking of might be " ("a" / "an") Are you saying that it would pick the result fairly randomly and then based on it's choice pick an animal that starts with a consonant or a vowel?