4 ms·

Title is a bit clickbaitish, but the content is well worth reading - came in with my pitchfork ready and left agreeing with basically all of it, with questions

by baq 2mo ago

Title is a bit clickbaitish, but the content is well worth reading - came in with my pitchfork ready and left agreeing with basically all of it, with questions like ‘what if the probe could return 3 dimensions: truthfulness, knowledge confidence and decidability?’ Also the observation that people treat LLMs like oracles when they’re everything but is spot on, something I’ve also been thinking about and it’s quite a bit scary.

lstodd 2mo ago
> what if the probe could return 3 dimensions: truthfulness, knowledge confidence and decidability? can't be done because the other two dimensions depend on the first. or in other words it's all the same dimension only with a different name.
- baq 2mo ago
  'I know this is true' is different than 'This is true' is different than 'It is impossible to say if it's true or false' is different than 'I've no idea', right?
  - lstodd 2mo ago
    no, and that's the point. hard to wrap your mind about this bit, yes.
    - baq 2mo ago
      from a practical point of view the point doesn't have any value, assuming it's even true; it'll take some convincing
      - lstodd 2mo ago
        I'd say it's equivalent to holding that any one worldview has no value in itself. Which is strictly true, but also conveys zero information.