3 ms·I guess you try to just zero the values that corresponds to unwanted tokens before the softmax.by GaggiX 3y agoI guess you try to just zero the values that corresponds to unwanted tokens before the softmax.