3 ms·
All my self-hosted inference has temperature zero and no randomness. It is absolutely workable, current inference engines are just lazy and dumb. (I use a Zob
by otabdeveloper4 7mo ago
All my self-hosted inference has temperature zero and no randomness.
It is absolutely workable, current inference engines are just lazy and dumb.
(I use a Zobrist hash to track and prune loops.)