As I've said before, one of my biggest concerns with LLMs is that they somehow manage to concentrate their errors in precisely the places we are least likely to

As I've said before, one of my biggest concerns with LLMs is that they somehow manage to concentrate their errors in precisely the places we are least likely to notice: https://news.ycombinator.com/item?id=39178183 https://news.ycombinator.com/item?id=39178183 If this is dangerous with normal English, how much more so with legal text. At least if a lawyer drafts the text, there is at least one human with some sort of intentionality and some idea of what they're trying to say when they draft the text. With LLMs there isn't. (And as I say in the linked post, I don't think that is fundamental to AI. It is only fundamental to LLMs, which despite the frenzy, are not the sum totality of AI. I expect "LLMs can generate legal documents on their own!" to be one of those things the future looks back on our era and finds simply laughable.)