4 ms·
As it describes it does eliminate non JSON outputs by masking the tokens while the LLM is generating. Its quite smart if you ask me.
by TeeWEE 3y ago
As it describes it does eliminate non JSON outputs by masking the tokens while the LLM is generating. Its quite smart if you ask me.
- kristjansson 3y agoIt’s very clever. I wouldn’t want it to be oversold.