2 ms·
Oh, this would be super neat for (our) language learning chatbot.. restricting the vocab the model uses.. if someone knows how this can be done. :)
by davidzweig 3y ago
Oh, this would be super neat for (our) language learning chatbot.. restricting the vocab the model uses.. if someone knows how this can be done. :)
- GaggiX 3y agoI guess you try to just zero the values that corresponds to unwanted tokens before the softmax.