3 ms·
Most of them don't expose more than top_p/top_k/temperature. Those are woefully inadequate compared to what open source inference engines support.
by Der_Einzige 3mo ago
Most of them don't expose more than top_p/top_k/temperature. Those are woefully inadequate compared to what open source inference engines support.