11 ms·
In the strict definition, it's deterministic: you get the same response for the same prompt, each time (given the exact same model). But the prompt is paramete
by genmon 4y ago
In the strict definition, it's deterministic: you get the same response for the same prompt, each time (given the exact same model).
But the prompt is parameterised. The bulk of the prompt is requesting a list of guests and speakers to be extracted, and the episode synopsis is appended as the "parameter". And I've noticed that the variation of the parameter changes what the overall prompt returns... so it might start being less reliable at responding with valid JSON, for example.
So it's instance-deterministic but, across a range of parameters, class-fuzzy, if that makes sense?