3 ms·
Still way behind on LLM sampler support compared to llama-cpp. Where's support for top-n-sigma? for DRY? for XTC? C'mon guys!
by Der_Einzige 1mo ago
Still way behind on LLM sampler support compared to llama-cpp. Where's support for top-n-sigma? for DRY? for XTC? C'mon guys!
- jasongill 1mo agoFeel free to submit a pull request
- ipnon 1mo agoYes, I think this project is a good example of how complex domains aren't simply solvable just by pointing ever more intelligence at the system, even when the code is all open source and the issues are all well defined. I say this as a contributor!
- Der_Einzige 1mo agoI did and no one did review despite me begging on the vllm slack!