4 ms·
Yeah and it's degraded significantly since then. Older llms were still mostly language focused and had a lot of latent knowledge about things like writing style
by Bolwin 2mo ago
Yeah and it's degraded significantly since then. Older llms were still mostly language focused and had a lot of latent knowledge about things like writing styles. Now it's crowded out in favor of agenetic work, programming etc.
- conception 2mo agoI’m surprised no one has distilled a 4o model yet that’s really good at prose. No money from enterprise users I suppose.
- gwern 2mo agoNo, the latent knowledge is larger than ever, as verified by many benchmarks (and instances like people being shocked by truesight of obscure forum posters). This is 100% a chatbot personality/alignment/post-training thing.
- HWR_14 2mo ago> truesight of obscure forum posters What does this mean?
- bloqs 2mo agoIt's almost like a claudeism
- Smaug123 2mo agoGwern, who posted that comment, is one of the early popularisers of the term. Janus used it in at least 2023, and Gwern in at least early 2024. If anything, you probably have the causation backwards: Claude talks like a LessWrong poster.
- mathgeek 2mo agoTruesight is a spell in D&D that allows you to see the true being behind an illusion or other deception.
- gwern 2mo agoStylometry on steroids: https://gwern.net/doc/statistics/stylometry/truesight/index https://gwern.net/doc/statistics/stylometry/truesight/index