4 ms·
large contexts degrade the performance - attention doesn't work will for large windows like that and cloud models are kind of hacking it local models do involv
by c0rruptbytes 4mo ago
large contexts degrade the performance - attention doesn't work will for large windows like that and cloud models are kind of hacking it
local models do involve some context engineering to get it okay, but it's not that rough