4 ms·
Unit testing: How would you automatically verify LLM output to a static prompt? Outputs can vary with each invocation.
by tintor 4y ago
Unit testing: How would you automatically verify LLM output to a static prompt? Outputs can vary with each invocation.
- dandiep 4y agoTemperature = 0 solves a lot of it, but not all. A list of all options solves a portion of the remaining. Not sure what to do about the rest - maybe ask the LLM?