3 ms·
At every generation step you mask the tokens so that only syntactically valid outputs are possible. This includes the <end> token.
by uoaei 3y ago
At every generation step you mask the tokens so that only syntactically valid outputs are possible. This includes the <end> token.