3 ms·
I'm screenshotting this, let's see who's right. Actually, your whole point about LLMs not being able to detect correctness is just demonstrably false if you pl
by phendrenad2 1y ago
I'm screenshotting this, let's see who's right.
Actually, your whole point about LLMs not being able to detect correctness is just demonstrably false if you play around with LLM agents a bit.
- 1718627440 1y agoA system outputting correct facts, tells you nothing about the system's ability to prove correctness of facts. You can not assert that property of a system by treating it as a black box. If you are able to treat LLMs as a white box and prove correctness about their internal states, you should tell that to some very important people, that is an insight worth a lot of money.
- phendrenad2 1y agoAs usual, my argument brought all the people out of the woodwork who have some obsession about an argument that's tangential. Sorry to touch your tangent, bud.
- 1718627440 1y ago> LLMs not being able to detect correctness is just demonstrably false if you play around with LLM agents a bit. How is telling you that this method of determining correctness is incapable of doing so, only tangential?
- phendrenad2 1y agoCorrectness and proven correctness are different things. I suspect you're a big Rocq Prover fan.