3 ms·
It actually works really well in my experience. But it eats up context. Using 500-600k token windows per inquiry isn’t cheap.
by conception 2y ago
It actually works really well in my experience. But it eats up context. Using 500-600k token windows per inquiry isn’t cheap.