3 ms·
Point 2 was the analysis I saw. Context size and token cost grow inversely at a rate that keeps prices constant, almost like supply and demand curves.
by dexwiz 1y ago
Point 2 was the analysis I saw. Context size and token cost grow inversely at a rate that keeps prices constant, almost like supply and demand curves.