4 ms·
I learned that exact style of writing in a marketing workshop, pre-AI. It's effective, satisfying, and a random third thing I can't be bothered to come up with
by wongarsu 4mo ago
I learned that exact style of writing in a marketing workshop, pre-AI. It's effective, satisfying, and a random third thing I can't be bothered to come up with right now.
As a proportion of all easily crawled text on the internet, a lot of it will be random marketing copy. That influenced the writing style of early AIs, and since then everyone has trained at least partially on transcripts from every other AI chatbot
- rayiner 4mo agoOh my god did we inadvertently train AIs on idiotspeak.
- LearnYouALisp 4mo agoIn-advert-ently?
- 12_throw_away 4mo ago> did we inadvertently train AIs on idiotspeak. Nope! That is - training on lowest-common-denominator, low-signal high-noise "idiotspeak" was not at all inadvertent.
- BoredPositron 4mo agoIt's engaging and I doubt it happened by accident.
- canucker2016 4mo agoIt seems to be called the Rule of 3. see https://en.wikipedia.org/wiki/Rule_of_three_(writing) https://en.wikipedia.org/wiki/Rule_of_three_(writing) Like Caesar's supposed "Veni Vidi Vici" saying, people seem to prefer and remember items when grouped in three. I recall a public speaking film shown to my management science class starring John Cleese mentioning this rule of 3.
- Sharlin 4mo agoGiven that this specific style is the result of being reinforced over and over again via RLHF, "inadvertently" isn't really the word I'd use.
- slowmovintarget 4mo ago* Checks notes * Reddit Twitter Facebook 4chan Call of Duty chat logs Every public marketing site SlashDot UseNet ... Verdict: Yes idiotspeak was part of the training set, but no, it was not inadvertent. There's a smattering of Shakespeare in there, at least.
- andrepd 4mo agoNo, we actually trained it on standardised tests https://marcusolang.substack.com/p/im-kenyan-i-dont-write-like-chatgpt https://marcusolang.substack.com/p/im-kenyan-i-dont-write-li...
- legitronics 4mo agoThank you for sharing this. It brought together things I had suspected but not from his perspective. Also pleasant to read something that used rhetorical devices in a cohesive way instead of just as sprinkled on flavor packets.
- Exoristos 4mo agoThere was nothing inadvertent about it. A decade of cultivating and harvesting millions of examples of this kind of pseudo-writing from underpaid internet piece-workers preceded LLMs.