3 ms·
We got an oral at ICLR for calling out how shit samplers like top_p and top_k are. Use min_p!
by Der_Einzige 2y ago
We got an oral at ICLR for calling out how shit samplers like top_p and top_k are. Use min_p!
- moffkalast 2y agoTrue yep, I wish more people benchmarked models with more representative sampler settings and then took the average of 5 or 10 responses.