4 ms·
As far as I understand, no. They're suggesting that smaller context windows are typically cheaper (fewer input tokens over time).
by conradludgate 2mo ago
As far as I understand, no. They're suggesting that smaller context windows are typically cheaper (fewer input tokens over time).