Great work! In your medium post, in the Post-processing section (step 1) you wrote: "If so, we re-run the evaluation prompt and force content_contains_answer to

Great work! In your medium post, in the Post-processing section (step 1) you wrote: "If so, we re-run the evaluation prompt and force content_contains_answer to be false." I assume you do this forcing by adding 'false' to the prompt (as if GPT completed it), just like to seed the JSON structure itself. Could you explain what you do with the justification in that case? Use it in the same way as if the result was 'false' in the first place? Do you have some stats on how often this even happens? In my experience, I have rarely seen these logprob thresholds actually get activated, because for binary token choices the probability of one of them is almost always >95%, but maybe this is because my prompts were not set correctly.