I really think the best use of language models is in... processing language. It’s a neat party trick that they can answer questions from parametric knowledge,

I really think the best use of language models is in... processing language. It’s a neat party trick that they can answer questions from parametric knowledge, but this ability is too unreliable to permit some of the uses this tech makes so tempting. Fortunately, a lot of real-world problems can be framed as transforming the input prompt (such as summarization, information extraction, translation, and open-book QA), and these are where LLMs offer the most promise.