4 ms·
Right now ChatGPT responses tend to be very confidently asserted, are overly verbose, and contain factual errors. So right now you could build model(s) that mea
by redeyedtreefrog 4y ago
Right now ChatGPT responses tend to be very confidently asserted, are overly verbose, and contain factual errors. So right now you could build model(s) that measure the assertiveness and wordiness of text. But then people could just instruct ChatGPT to give brief answers, or to make itself sound uncertain. And soon there will be many similar models, and many will be more terse and less assertive by default. Regarding factual mistakes, that's not something you can check with a model that isn't itself more advanced than the LLM it is assessing.