2 ms·
Just don’t copy their sampler. It’s trashcan-tier. Bad defaults and no repetition penalty.
by sillysaurusx 4y ago
Just don’t copy their sampler. It’s trashcan-tier. Bad defaults and no repetition penalty.
- toxik 4y agoI think tuning the sampler temperature and using top-k over top-p sounds ad hoc and shouldn’t be necessary for a solid model. Do you have any reason for suggesting those changes in particular? Especially since top-p, or nucleus sampling, is meant to be an improvement over top-k.