> You can choose which token to sample based on language semantics Can you though? > the language should be restrictive on what tokens it allows This is a re

> You can choose which token to sample based on language semantics Can you though? > the language should be restrictive on what tokens it allows This is a restriction on the language syntax, not its semantics.