3 ms·
Have you found a solution to output exceeding the context window? That's been our only issue with generating json output.
by calderwoodra 3y ago
Have you found a solution to output exceeding the context window? That's been our only issue with generating json output.
- remilouf 3y agoThe Finite-State Machine we walk on during the generation process does not suffer from this problem so we can still output correct JSON, if that’s what you’re asking.