4 ms·
I'm pretty sure you can adjust the creativity for many Chinese model inference providers.
by aurareturn 3mo ago
I'm pretty sure you can adjust the creativity for many Chinese model inference providers.
- Der_Einzige 3mo agoMost of them don't expose more than top_p/top_k/temperature. Those are woefully inadequate compared to what open source inference engines support.