3 ms·
The model doesn't particularly "know" which tokens within its output are "comments", it's not so easy
by kfse 2mo ago
The model doesn't particularly "know" which tokens within its output are "comments", it's not so easy
- alasdair_ 2mo agoIt knows when several tokens are about equal vs. times where one token is vastly preferred. In the latter case, that’s usually code or math or something similar and so it won’t alter those tokens.