4 ms·
Just a caveat, this is 128k context length for ingestion, I believe the output is still constrained to just 4k tokens.
by computerex 3y ago
Just a caveat, this is 128k context length for ingestion, I believe the output is still constrained to just 4k tokens.
- ravenstine 3y agoYes, this is true. Nevertheless, that made a huge difference for my workflow. I haven't had to think about exceeding the total context in a long time.