The paper is full of insightful parts. For instance, on challenge with LLMs is parsing the model output. The participants suggest that instead of forcing the mo

The paper is full of insightful parts. For instance, on challenge with LLMs is parsing the model output. The participants suggest that instead of forcing the model to return a JSON, it should be allowed to return the results in its preferred format, and then these results can be parsed into a structured format. Quote: "if the model is kind of inherently predisposed to respond with a certain type of data, we don’t try to force it to give us something else because that seems to yield a higher error rate"