4 ms·
That shows that the censorship mechanism happens at the token sampling level and not post generation, at the least
by nextworddev 2y ago
That shows that the censorship mechanism happens at the token sampling level and not post generation, at the least
- int_19h 2y agoOn the contrary, it shows that the censorship mechanism is post-generation and stops it once it deems the output accumulated so far "improper". It just runs after every token.