3 ms·
token rot exists for any context window at above 75% capacity, thats why so many have pushed for 1 mil windows
by AtreidesTyrant 9mo ago
token rot exists for any context window at above 75% capacity, thats why so many have pushed for 1 mil windows