3 ms·
token rot exists for any context window at above 75% capacity, thats why so many have pushed for 1 mil windows
by AtreidesTyrant 7mo ago
token rot exists for any context window at above 75% capacity, thats why so many have pushed for 1 mil windows