5 ms·
Even LLMs from years ago could accurately mimic the style of any sufficiently famous author.
by akoboldfrying 2mo ago
Even LLMs from years ago could accurately mimic the style of any sufficiently famous author.
- est 2mo agoLLMs from years ago weren't aligned to death like these days. It's hard to get rid of "AI smell" than years ago.
- throwawaydfasjf 2mo ago[dead]
- Bolwin 2mo agoYeah and it's degraded significantly since then. Older llms were still mostly language focused and had a lot of latent knowledge about things like writing styles. Now it's crowded out in favor of agenetic work, programming etc.
- conception 2mo agoI’m surprised no one has distilled a 4o model yet that’s really good at prose. No money from enterprise users I suppose.
- gwern 2mo agoNo, the latent knowledge is larger than ever, as verified by many benchmarks (and instances like people being shocked by truesight of obscure forum posters). This is 100% a chatbot personality/alignment/post-training thing.
- HWR_14 2mo ago> truesight of obscure forum posters What does this mean?
- bloqs 2mo agoIt's almost like a claudeism
- Smaug123 2mo agoGwern, who posted that comment, is one of the early popularisers of the term. Janus used it in at least 2023, and Gwern in at least early 2024. If anything, you probably have the causation backwards: Claude talks like a LessWrong poster.
- mathgeek 2mo agoTruesight is a spell in D&D that allows you to see the true being behind an illusion or other deception.
- gwern 2mo agoStylometry on steroids: https://gwern.net/doc/statistics/stylometry/truesight/index https://gwern.net/doc/statistics/stylometry/truesight/index
- casey2 2mo agoAt best it can use some of the same vocabulary. Often not even then.
- andai 2mo agoThe base models were really good at this. These days even the "base" models are full of awful synthetic data.
- R_D_Olivaw 2mo agoCan anyone point me in the right direction on how to get these models back? I really like the older ones for NPC dialogue for TTRPG campaigns and the like. I just looked into it and I think I can still find GPT 3.5, but wonder if it too has been trained out of usefulness. The characters a styles were quirky and not always perfect, but added a lot more flavor and character nuance that could be corrected with editing.
- fwn 2mo agoI have no experience with style imitation, so perhaps I'm missing something here. I asked Kimi K3 to rewrite your comment in the style of Ernest Hemingway: > I would like to get the old models back. If anyone can show me the way, I would be grateful. I liked them for NPC dialogue, for TTRPG campaigns and the like. > I looked into it. GPT 3.5 is still around, I think. But perhaps they have trained it out of usefulness. It is difficult to say. > They were quirky, the old ones, and not always perfect. But they had flavor, and their characters had nuance, and what they got wrong you could fix in the editing. Full conversation with thinking: https://paste.ononoki.org/?2fc049fe1ae7302b#GjzuEn8VmaYJ565Mk7Kb4cMEyY8y81EMcMWm6b22ex2e https://paste.ononoki.org/?2fc049fe1ae7302b#GjzuEn8VmaYJ565M... Password: kimitest
- onemoresoop 2mo agoHow token efficient is kimi? How much do you average each month for example?
- R_D_Olivaw 2mo agoThis is really neat, but if you'll notice, it just kept the same words and rewrote it a few different ways. I guess what I'm actually thinking of it's when the model temperatures weren't quite dialed in and you would get some wonky stuff that was genuinely useful for character exposition and giving a particular character a "voice".
- deleted 2mo ago[deleted]
- giancarlostoro 2mo ago