4 ms·
Yeah and it's degraded significantly since then. Older llms were still mostly language focused and had a lot of latent knowledge about things like writing style
by Bolwin 3mo ago
Yeah and it's degraded significantly since then. Older llms were still mostly language focused and had a lot of latent knowledge about things like writing styles. Now it's crowded out in favor of agenetic work, programming etc.
- conception 3mo agoI’m surprised no one has distilled a 4o model yet that’s really good at prose. No money from enterprise users I suppose.
- gwern 3mo agoNo, the latent knowledge is larger than ever, as verified by many benchmarks (and instances like people being shocked by truesight of obscure forum posters). This is 100% a chatbot personality/alignment/post-training thing.
- HWR_14 3mo ago> truesight of obscure forum posters What does this mean?
- bloqs 3mo agoIt's almost like a claudeism
- Smaug123 3mo agoGwern, who posted that comment, is one of the early popularisers of the term. Janus used it in at least 2023, and Gwern in at least early 2024. If anything, you probably have the causation backwards: Claude talks like a LessWrong poster.
- mathgeek 3mo agoTruesight is a spell in D&D that allows you to see the true being behind an illusion or other deception.
- gwern 3mo agoStylometry on steroids: https://gwern.net/doc/statistics/stylometry/truesight/index https://gwern.net/doc/statistics/stylometry/truesight/index