3 ms·
I'd push back on summarization being solved. I have extensively used GPT 3.5 and 4 for this in production, and it works very well but it still often just ignore
by skepticATX 3y ago
I'd push back on summarization being solved. I have extensively used GPT 3.5 and 4 for this in production, and it works very well but it still often just ignores critical aspects of the original text, and it will rarely even completely hallucinate details. And this is with a lot of iteration on the prompt.
We still have to throw out > 50% of its output because a human can summarize the text much better.