3 ms·
Zero discussion around LLM sampling. How do you leave such a gaping hole in such a written piece? I know it's not AI cus AI wouldn't be that sloppy.
by Der_Einzige 11mo ago
Zero discussion around LLM sampling. How do you leave such a gaping hole in such a written piece? I know it's not AI cus AI wouldn't be that sloppy.
- ttkciar 11mo agoLocal inference users are all about sampling, but users addicted to commercial inference services are wary of sampling, because they have to pay by the token.