I'll shamelessly plug my somewhat related but even less polished take on a text generation studio. I was fascinated by the idea of constraining an LLMs vocabul

I'll shamelessly plug my somewhat related but even less polished take on a text generation studio. I was fascinated by the idea of constraining an LLMs vocabulary and it ended up as a publication and this: https://github.com/Hellisotherpeople/Constrained-Text-Generation-Studio/tree/main https://github.com/Hellisotherpeople/Constrained-Text-Genera...