5 ms·
Machine-generated husband chatter
- donquichotte 9y agoStrangely enough, I find the output of Markov Chain - type text generators much more readable and coherent than the output of those RNNs. A Marov Chain text generator is also easy to implement and understand.
- visakanv 9y agoInteresting. Why do you think that is? (More readable, that is)
- aninhumer 9y agoIf I were going to guess (not the parent), it's because human parsing is quite localised, and Markov models tend to optimise well for localised coherence. Their failure mode is long sentences which don't go anywhere (or mean anything), but that's less grating than a blatant parse failure, especially if you're skim reading.
- visakanv 9y agoThat actually makes a lot of sense, great point.
- marktangotango 9y agoClaude Shannon[1], information theory guy, worked on machine generated music quite a lot. Some of the ideas transfer. Information theory informs a lot in this area[2]. [1] https://en.wikipedia.org/wiki/Claude_Shannon https://en.wikipedia.org/wiki/Claude_Shannon [2] http://www.music-cog.ohio-state.edu/Music829D/Notes/Infotheory.html http://www.music-cog.ohio-state.edu/Music829D/Notes/Infotheo...
- visakanv 9y agoFascinating!
- Infernal 9y agoI wonder how hard it would be to use a Markov chain as a syntactic filter on the output of the RNNs?
- umlaut 9y agoThe interesting properties of RNNs aren't in readability. RNNs can learn syntactical states, e.g. "this text is in quotes" that enable some really cool analysis tricks. OpenAI published an article about this recently, where they showed that an RNN, without being trained on it, learned the difference between positive and negative reviews. The fact that an RNN encodes sentiment is an incredibly useful feature. source: https://blog.openai.com/unsupervised-sentiment-neuron/ https://blog.openai.com/unsupervised-sentiment-neuron/
- sharanvkaur 9y agothanks for bringing this up! i saw this article last week and it THRILLED me. so much potential here.
- hypfer 9y agoI've also did this a few months ago with a dump of all my telegram messages. I thought it could be a nice chatbot. I was wrong. :-(
- visakanv 9y agoHaha yeah it's a little disappointing (yet interesting) how it comes close but misses the mark. I wonder how far away we are to having machine-generated output that's tough to distinguish from the input you put into it.
- simonh 9y agoThe Obama one is much better, but the thing is none of these are even remotely close. They sort of seem close on the surface if you simply don't engage any critical parts of your brain, or try to extract any meaning, but if you do the semblance of meaning that's inherent in the words melts away into nothing. To generate output that contained meaning that you could actually engage with, you'd have to first generate the meaning and then turn that into text. That's a fundamentally different process to what is going on here. This is also why 'Turing Test' competitions involving chat bots are never going to give us artificial intelligence. This sort of text generation is like a magician's trick where he appears to saw the woman in half and put her together again. I don't care how good the magician is at the trick, he's not going to be any help at all to a surgeon that's actually cutting someone in half and then stitching them back together again.
- visakanv 9y ago> This sort of text generation is like a magician's trick where he appears to saw the woman in half and put her together again. That's a really good analogy!
- sharanvkaur 9y agoyep, this is so true. i was really excited about the tiny fragments that seemed to hold meaning, but they were obviously just happy accidents.
- 9y ago
- Artlav 9y agoAh, this brings back memories. I tried something like that about 12 years ago, with a homebrewn half-hardcoded, half-neural thing and a large set of Jules Verne books. The giddy excitement of being on the verge of unlocking the power of language slowly turned into confusion and then decayed into disappointment as i slowly realized that the task was maybe a bucket of orders of magnitude harder than i thought. I think it produced some coherent phrases every now and then, but mostly it was a random words generator. ...I miss these amplified feelings of cluelessly diving into an impossible project...
- visakanv 9y ago> The giddy excitement of being on the verge of unlocking the power of language slowly turned into confusion and then decayed into disappointment as i slowly realized that the task was maybe a bucket of orders of magnitude harder than i thought This was very wonderfully articulated! Do you have a blog or something?
- ominous 9y agoRelated xkcd: https://xkcd.com/1425/ https://xkcd.com/1425/
- Pica_soO 9y agoKnowledge kills the enthusiasm. One can move but doesn't know where and how, the other knows where and how, and spends the life in kotau.
- xaedes 9y agoI really want to try this on small refactoring git commits to reproduce a simple ml-based code optimization engine.
- visakanv 9y agoYou should totally do it! Would love to see what happens.
- janwillemb 9y agoThe title is from the perspective of the submitter (being the husband in the original title), it should be "visakanv-RNN — machine-generated husband chatter". Which is a lot less catchy.
- greydius 9y agoDoes that include starting sentences with "so"? Is anyone else annoyed by this?
- thiagocsf 9y agoTrained a neural net to write like me: poorly.
- visakanv 9y agoHahaha! Yeah, maybe that's part of what makes the output distinctive. Do you have any good recommendations for a person looking to improve their shoddy writing?
- deleted 9y ago[deleted]
- visakanv 9y agoAre you talking about the submission title? =/
- jorgescx 9y agoReminds me somehow of SCIgen (https://pdos.csail.mit.edu/archive/scigen/ https://pdos.csail.mit.edu/archive/scigen/), a funny 'scientific paper generator'.
- wolfgang42 9y agoIn a similar vein, http://git-man-page-generator.lokaltog.net/ http://git-man-page-generator.lokaltog.net/ creates plausible-sounding man pages for git internals.
- ada1981 9y agoWasn't expecting the image at the end, wtf?
- Asparagirl 9y agoShe should call this the HusBot.
- sharanvkaur 9y agothis is clearly way better than visakanv-rnn. thanks!
- Asparagirl 9y ago:-)
- diyseguy 9y agoI came up with similar results by just tracking word probabilities and then regenerating text based on those probabilities. Feeding it Edgar Allen Poe produced the best results: twelve vibrations of purple air. vortex of its absolute hurricane. monck flying footsteps of the picture all the police are concerned. silence on a year in an identity. materiality escaping the city was their white spot of printing apparatus all things only one supposes it were its mere duration that it in baltimore monument to its luxuriant nature asserts her person whom i not hesitate about five hundred paces to have not the principia of idiotic thought of curvature or metamorphosis these friends were in an earthquake and the then i felt my chair so rigidly of interest could not summon courage Here's the TED version I just generated using the input.txt from one of the linked articles: https://github.com/samim23/TED-RNN/ https://github.com/samim23/TED-RNN/ educationists made around in our modern medicine. gq did make perfect mankind which the blue pill every week had infinite instant messaging that sucks when your food day that previous background is about being foreign interventions. psychopharmaceutical arsenal. attached to tail but a distribution units in our traditional estimates that men engineers who negotiate my whole province of long awkward to call it came back go deep conversations you grow fast when there been around the long lever systems. entertaining anyway, and occasionally amazing
- kristjansson 9y agoHoly shit, that's awesome. Do you have the code used to generate this available somewhere?
- diyseguy 9y agoThanks for noticing! :) I will tidy it up and put it out there soon. I'll let you know after I've done that. :)
- visakanv 9y agoThis is beautiful.