4 ms·
My impression is this is more useful for making efficient use of the context window and not as relevant for decreasing costs. It would decrease costs if you wan
by babyshake 4y ago
My impression is this is more useful for making efficient use of the context window and not as relevant for decreasing costs. It would decrease costs if you want to reuse the compressed information many times, similar to how the cost savings of a compressed file would be apparent when reusing the compressed file.
- weird-eye-issue 4y agoYeah except this doesn't actually work reliably.