3 ms·
But that's not what an LLM does.
by neoncontrails 3y ago
But that's not what an LLM does.
- antonvs 3y agoThe point is that if you're "choosing the next token based on a list of valid next tokens," it's not surprising that you'll only generate valid output, since absolutely any choice mechanism will suffice.