Huh. Thought it was pretty clear. I read it as: ~ "We tried a new optimization technique that modifies how next token candidates are chosen and there was a bug

Huh. Thought it was pretty clear. I read it as: ~ "We tried a new optimization technique that modifies how next token candidates are chosen and there was a bug." That would definitely produce the behavior people saw and makes sense.