6 ms·
I came to this same conclusion some years ago while working on a side project. Before anything LLM existed, I built a site[0] to generate fake "AWS Blog Posts.
by fishtoaster 2y ago
I came to this same conclusion some years ago while working on a side project.
Before anything LLM existed, I built a site[0] to generate fake "AWS Blog Posts." I trained a markov chain generator on all AWS announcement posts up to that point, copied the html + css of aws's standard blog posts, then glued them all together with some python + JS. It turned out, IMO, pretty funny! People familiar with AWS's blog posts would often get several sentences in before they realized they were looking at word-soup.
When GPT was new, I looked into using that to "upgrade" it. I spent a weekend messing around with Minimaxir's gpt-2-simple generating blog posts based on AWS content. What I found was, ultimately, it was way less fun. The posts were far too realistic to be interesting. They read like totally-real blog posts that just happened to not be true.
I realized then that the humor of those early markov generations was the ridiculousness. The point where, a few words or sentences in, you realized it was all nonsense. LLM's these days are too good for that - the text they generate is sometimes wrong, but rarely nonsense in a humorous way.
Markov chain content was wrong in a "kid's say the darndest things" way, while modern LLMs are wrong in a "My uncle doesn't know basic geography" way.
[0] https://totes-not-amazon.com/ https://totes-not-amazon.com/ - click any link to get a new one.
- fouronnes3 2y agoReminds me of git man pages generators. Extremely fun as well when you can't quite tell if it's real.
- majewsky 2y agoRef: https://git-man-page-generator.lokaltog.net/ https://git-man-page-generator.lokaltog.net/
- mdp2021 2y ago> modern LLMs are wrong in a "My uncle doesn't know basic geography" way Oh, certainly not. I have been using LLM chatbots extensively this week. If your uncle were not just confident while stating falsities, but uncapable of self-assessment, he would have been murdered.
- TeMPOraL 2y agoOr made a stellar career as a salesman or politician.
- Kiro 2y ago[flagged]
- mdp2021 2y ago> This reads Oh please. Guidelines: «respond to the strongest plausible interpretation». Does the form "An occasion of extensive use of the main current chatbots for circumstantial reasons in the past few days confirmed and reinforced the assessments raised years ago already" work better for you?
- wizzwizz4 2y ago
- kqr 2y ago(a) That site is very funny. Thanks for sharing! (b) The kids-vs-uncle metaphor is spot on in my experience too, and also illustrates how far these language models have come.
- daemin 2y agoI think the "uncle that doesn't know anything but claims to be an expert and will tell you his opinion" is the best description of LLMs that I can think of. They will say anything confidently without knowing anything.
- HeatrayEnjoyer 2y agoPerfectly humanlike
- hoseja 2y agoWe gave up the pursuit of pure crystalline Intelligence and instead just remade ourselves. Hopefully the AIs will be able to do better.
- Bluestein 2y agoYeah. We don't need Artificial Intelligence. We need to discover Actual Intelligence :)
- HPsquared 2y agoIndeed, the more I use LLMs and see the confabulated output, I've started seeing similar in how actual people talk.
- deleted 2y ago[deleted]
- pbronez 2y ago[flagged]
- boredemployee 2y ago>> They will say anything confidently without knowing anything. Understanding how these algorithms work, I don't know why we would expect anything different from this?
- 2y ago
- DeadlockISDota3 2y agoI figured this same thing in a similar manner. I used to make markov chains of game patches and send them to the community. Fake dota patches were a huge hit, specially since those are usually huge. Among mostly non-sense or unfunny exaggeration ("this hero now has 500 armor"), there would usually be at least 5 or 6 extremely funny lines in there, if not stuff that was outright prophetic (Fiend's Grip creates additional 1/2/3 illusions). LLM's did a number on that unfortunately. Major subreddits banned all AI content, mostly due to the sheer infestation of really boring Midjourney content sent out by naive users and bots. Without reach, I lost interest, so no more Markov Chains.
- unshavedyak 2y agoHah, i felt compelled to mention Deadlock because of your Dota comments. Then i noticed your name.
- erk__ 2y agoI am sure I even remember that Valve once incorporated something from one of the fake patch notes in one of their patches, but now I cannot find it. It was something like +1 damage to something that already did a lot of damage.
- tyjo99 2y agoProbably the Techies +25x damage talent? In 2017 [7.07] it was increased from +250 damage to +251 damage. Then in 2020 [7.28] it was increased again to +252 damage.
- erk__ 2y agoAfter some more looking around I found it, Puck's orb gained 1 movement speed in 6.87 [0] after the markov chain notes for the patch [1]. Though I think the techies one is a similar joke. [0]: https://www.dota2.com/687 https://www.dota2.com/687 [1]: https://old.reddit.com/r/DotA2/comments/4fw6gm/how_687_would_look_like_if_icefrog_was_a_markov/ https://old.reddit.com/r/DotA2/comments/4fw6gm/how_687_would...
- nom 2y agoFirst thing I read on that page: > There is no charge associated with your streamed applications, simply click Enable Microphone from the ElastiCache documentation. It's way funnier when our brains try to make sense of the nonsense.
- maicro 2y agoI played around with a Markov generator many years ago, trained on the corpus of everything I had ever said in a specific IRC channel. The resulting messages were pretty interesting - I specifically remember the realization that I apparently (used to, though honestly still do, too) talk about LEDs a lot...
- passion__desire 2y agohttps://cemulate.github.io/the-mlab/#y3Bt-co-extensional+limit https://cemulate.github.io/the-mlab/#y3Bt-co-extensional+lim... https://github.com/cemulate/the-mlab https://github.com/cemulate/the-mlab This is a parody of the nLab, a wiki for collaborative work on category theory and higher category theory. As anyone who's visited is probably aware, the jargon can be absolutely impenetrable for the uninitiated -- thus, the idea for this project was born! This project uses my package nearley-generator, a module that can turn a Nearley grammar into an efficient and controllable fake text generator. The grammar file for this site can be found at /src/grammar/nlab.ne
- xnx 2y ago> What I found was, ultimately, it was way less fun I wonder if there is combination of temperature and prompt engineering that could make it interesting.
- shawabawa3 2y agoI just asked chatgpt to create an Aws product announcement in the style of Markov generated text and it was pretty good
- m3047 2y agoI did the same thing and used it as the chum for a 'bot motel. (A 404 handler that always returns something and... success!). I trained it on a mixed NASA space shuttle and veterinary science corpus just to make it really bizarre.
- to11mtm 2y ago> I realized then that the humor of those early markov generations was the ridiculousness. The point where, a few words or sentences in, you realized it was all nonsense. LLM's these days are too good for that - the text they generate is sometimes wrong, but rarely nonsense in a humorous way. This is the biggest challenge I run into when I see LLM Generated nonsense. So much stuff that ChatGPT spits out is close enough to true that Brandolini is laughing. But it's also that it's borrowing on stuff that's already there so it can't really get that 'creative' either.