4 ms·
Efficiency: By generating only the content tokens and filling in the fixed tokens, Jsonformer is more efficient than generating a full JSON string and parsing i
by yawnxyz 3y ago
Efficiency: By generating only the content tokens and filling in the fixed tokens, Jsonformer is more efficient than generating a full JSON string and parsing it.
I was excited to try this in Replit... and realized it required pytorch. Ouch. Replit was not happy about that!