4 ms·
Most important? The idea that not every token needs the full context window should be an obvious optimization.
by imtringued 3y ago
Most important? The idea that not every token needs the full context window should be an obvious optimization.
- whimsicalism 3y agothat’s not the idea here