4 ms·
Do we know what the cost is for increasing the window size? I'd imagine that each additional token of range requires ever more power to properly integrate, bu
by Baeocystin 6y ago
Do we know what the cost is for increasing the window size? I'd imagine that each additional token of range requires ever more power to properly integrate, but that is only a hunch.
- orost 6y agoI believe it's quadratic, but that still means making it 10x larger is perfectly possible just by brute force with a little motivation.
- Baeocystin 6y agoInteresting. That's less steep than I would have naively guessed. And you're right, if it's that 'easy', the next iteration will be (1) soon and (2) awesome, in both the positive and negative sense of the word.