4 ms·
Not true and citation needed. Whatever you cite there are competing papers claiming that structured and constrained generation does zero harm to output diversit
by Der_Einzige 1y ago
Not true and citation needed. Whatever you cite there are competing papers claiming that structured and constrained generation does zero harm to output diversity/creativity (within a schema).
- astrange 1y agoThat is clearly not possible. Imagine if you asked a model yes/no questions with a schema that didn't contain "yes". In general you can break any model by using a sampler that chooses bad enough tokens sometimes. I don't think it's well studied how well different models respond to this.