5 ms·
LSTM trained on HN
- woliveirajr 9y agoNext step: someone will build a mix of real headlines and LSTM-generated ones and will post it as a challenge, where a perfect 20 out of 20 will never be conquered.
- gallerdude 9y agoA new sort of Turing Test...
- tyingq 9y agoI wonder if it uses words like "orthogonal" and "bikeshedding" more than it should.
- dgreensp 9y agoBrain drivers are reality as a service Some pretty hilarious and/or thought-provoking headlines! LSTMs capture so much about the input (compared to N-grams, say), it can be almost eerie.
- noiv 9y agoI scanned the list and attached a subjective clickbaitiness to each 'headline'. Of course without reading the article. Yours got 100%. I learned two things, this network knows how to make HN visitors click. It is hard to extract knowledge from a NN.
- udsloiwdaa 9y ago>Show HN: Universal Basic Income in Elixir fucking lost
- rcarmo 9y agoI thought " The State of the Post Neural Network Attack" was both pretty meta and superbly on point. But yes, reading through the titles was eerily realistic.
- minimaxir 9y agoAs someone who's cited by the OP and coincidentally released a tool today that easily trains a LSTM on any dataset demoed with Hacker News data (https://github.com/minimaxir/textgenrnn https://github.com/minimaxir/textgenrnn), I have a couple comments: 1) My Get All Hacker News Submissions script is somewhat obsolete since all HN data is now on BigQuery (will add a note to the README today) 2) There is a massive, massive selection bias in terms of the quality of the selected generated texts. If you look at the sample output (https://github.com/danhon/deep-hackernews/blob/master/sample-output/hn-titles-rsize512-temp0.45-1e6-1.txt https://github.com/danhon/deep-hackernews/blob/master/sample...), there is a large disparity in quality between the chosen submissions for the blog post and a typical generated submission. (this is expected, although the need for human curation damages the "Turing test" suggestions proposed by other commenters) Compare with the sample output at similar temperature from my 128-cell LSTM network (https://github.com/minimaxir/textgenrnn/blob/master/outputs/hacker_news_temp_0_5.txt https://github.com/minimaxir/textgenrnn/blob/master/outputs/...), which is several orders smaller (OP uses a 512-cell network), and many magnitudes lower amount of training data. (I am curious how long OP spent training the network.)
- AdmiralAsshat 9y ago> Ask HN: What do you use for developers? Brilliant.
- Talyen42 9y agoMy favorites: # I like Self-Driving Cars Using Docker Components # Elon Musk says he will be more than a secret artificial intelligence # Show HN: A web browser for harassment in 2017 # Slack is the future of the world # China has died
- deleted 9y ago[deleted]
- andybak 9y ago"Technology reveals the best way to stop using Rust" won for me.
- reitanqild 9y agoSome of my favourites: The Man Who Continues to Code (2013) How to Start a Basic Income as a Service Ask HN: What is the best way to sell the blockchain in 2017? Self-Driving Cars Using Docker Components ⏱ Show HN: A command-line tool for creating a startup in 100 mins
- ak_yo 9y agoHow does this compare to 2-gram Markov chains? The results look pretty similar (though perhaps a bit more grammatical...)