4 ms·
Oh my god did we inadvertently train AIs on idiotspeak.
by rayiner 4mo ago
Oh my god did we inadvertently train AIs on idiotspeak.
- LearnYouALisp 4mo agoIn-advert-ently?
- 12_throw_away 4mo ago> did we inadvertently train AIs on idiotspeak. Nope! That is - training on lowest-common-denominator, low-signal high-noise "idiotspeak" was not at all inadvertent.
- BoredPositron 4mo agoIt's engaging and I doubt it happened by accident.
- canucker2016 4mo agoIt seems to be called the Rule of 3. see https://en.wikipedia.org/wiki/Rule_of_three_(writing) https://en.wikipedia.org/wiki/Rule_of_three_(writing) Like Caesar's supposed "Veni Vidi Vici" saying, people seem to prefer and remember items when grouped in three. I recall a public speaking film shown to my management science class starring John Cleese mentioning this rule of 3.
- Sharlin 4mo agoGiven that this specific style is the result of being reinforced over and over again via RLHF, "inadvertently" isn't really the word I'd use.
- slowmovintarget 4mo ago* Checks notes * Reddit Twitter Facebook 4chan Call of Duty chat logs Every public marketing site SlashDot UseNet ... Verdict: Yes idiotspeak was part of the training set, but no, it was not inadvertent. There's a smattering of Shakespeare in there, at least.
- andrepd 4mo agoNo, we actually trained it on standardised tests https://marcusolang.substack.com/p/im-kenyan-i-dont-write-like-chatgpt https://marcusolang.substack.com/p/im-kenyan-i-dont-write-li...
- legitronics 4mo agoThank you for sharing this. It brought together things I had suspected but not from his perspective. Also pleasant to read something that used rhetorical devices in a cohesive way instead of just as sprinkled on flavor packets.
- Exoristos 4mo agoThere was nothing inadvertent about it. A decade of cultivating and harvesting millions of examples of this kind of pseudo-writing from underpaid internet piece-workers preceded LLMs.