2 ms·
This is irrelevant for local LLMs where a seed value may be specified and generation is totally deterministic. This only helps with online LLMs.
by 9642370096647 11mo ago
This is irrelevant for local LLMs where a seed value may be specified and generation is totally deterministic. This only helps with online LLMs.