4 ms·
> With LLMs, we can give the exact same instructions, and not be guaranteed the same code. Set temperature appropriately, that problem is then solved, no?
by jsjohnst 2y ago
> With LLMs, we can give the exact same instructions, and not be guaranteed the same code.
Set temperature appropriately, that problem is then solved, no?
- sdesol 2y agoNo, it is much more involved and not all providers allow the necessary tweakings. This means you will need to use local models (with hardware caveats) which will require us to ask: - Are local models good enough? - What are we giving up for deterministic behaviour? For example, will it be much more difficult to write prompts. Will the output be nonsensical and more.