4 ms·
Overthinking produces more junk text which overall clutters the model's context window and reduces the effectiveness of attention in the first place. It's autoc
by talldayo 2y ago
Overthinking produces more junk text which overall clutters the model's context window and reduces the effectiveness of attention in the first place. It's autocomplete - if you precede it with a bunch of junk data, you're going to get junk suggestions back.