10 ms·
Show HN: A/B test Hacker News titles with AI
- Michael_Sieb 6y agoLol! Is it build with OpenAI?
- dstick 6y agoYour answer is a mere 2 clicks away: https://github.com/Grew-dev/hacker-ai/blob/main/README.md https://github.com/Grew-dev/hacker-ai/blob/main/README.md
- Michael_Sieb 6y agoNice thanks!
- Closi 6y agoGreat idea, Love things like this! Competition time - Can anyone come up with a title better than "Rust"? Edit: I've beaten "Rust" by putting in the title " ". Can anyone beat that?! AI clearly has worked out the less substance the better!
- tyingq 6y agoAzure ties the single space, as does Perl and also Bezos.
- metafunctor 6y ago“News” appears to win all of those, but “ ” is still better.
- wizzwizz4 6y agoAnd newt beats " ", because t > s.
- deleted 6y ago[deleted]
- metafunctor 6y agoIt seems two spaces " " wins " ". There's no substance, but more of it! Edit: looks like it's maybe a tie, instead. B wins in case of a tie.
- dfdz 6y agoThe best I can find is [space] died “ died” it beats rust, java, and even double space
- oefrha 6y agoconst randAlphaStr = length => String.fromCharCode( ...Array.from({ length }, () => 97 + Math.floor(Math.random() * 26)) ); const pitRustAgainstRandomFourCharAlphaStrings = async sampleSize => { const rustScore = await getPrediction("rust"); let rustLosses = 0; for (let i = 0; i < sampleSize; i++) { if ((await getPrediction(randAlphaStr(4))) > rustScore) { rustLosses++; } } console.log(`rust lost ${rustLosses} times out of ${sampleSize}`); }; pitRustAgainstRandomFourCharAlphaStrings(100000); Result: rust lost 55469 times out of 100000 I'd say rust fairs worse than the average random four character string with the letters a-z. That should tell you something about the usefulness of this model.
- Closi 6y agoCan you use your superpowers to find us the best 4 character string?
- tyingq 6y agoTitle A: Show HN: New grep tool written in Rust Title B: Show HN: New grep tool written in PHP (7% better) Hmm. FWIW, Python fares worse than Rust, C++ beats PHP by 2%.
- GordonS 6y agoMy guess for PHP scoring higher than Rust is that people love to hate on PHP - it's practically the HN national sport! NB! I'm not arguing for or against PHP, and don't want to take this thread on THAT particular tangent!
- DC-3 6y agoChecks out to me. The first one already exists while the second one is hilarious.
- timy2shoes 6y agoTitle A: Show HN: New grep tool written in Python Title B: Show HN: New grep tool written in Garbage (1% better) I guess Python is 1% worse than garbage. Lol
- mbenchi10 6y agoTITLE A: Someone should sell this- Montessori toys [4% better] TITLE B: How you can earn $46k/M selling Montessori toys Tried it for on of our ProdcutByte products
- deleted 6y ago[deleted]
- wizzwizz4 6y agoPlease don't use this in practice. It's trained on a dataset that it then ends up affecting, so we could end up with some really weird situations.
- Gys 6y ago> dataset that contains all stories and comments between 2006 and 2017 That seems rather old data for a tech community?
- mch82 6y agoThe oldest day archived online is February 19, 2007 —> https://news.ycombinator.com/front?day=2007-02-19 https://news.ycombinator.com/front?day=2007-02-19
- thesausageking 6y agoFrom their README: "Hacker-AI uses a brain.js feed-forward neural network machine learning model that has been trained with the below dataset that contains all stories and comments between 2006 and 2017...The current algorithm has been tested with approx. 10.000 posts. It has been able to predict 60% of the cases correctly."
- yoboiai 6y agoAwesome work!
- numbman 6y agoI love it when people come here and shit about old data sets or other bs. Gj op! Haters going to hate and makers going to make.
- mrpickels 6y agoGay is 23% better than Straight. Is HN a gay hub?
- jonplackett 6y agoI want to know how many titles they A/B tested to get this one.
- IfOnlyYouKnew 6y ago"Trump" wins against "sex". Go figure...
- abpavel 6y agoSeems to be affected by heavily by capitalization in a surprising way. "Show HN: AI OpTiMiZeR ToOl" fares 6% better than same written in non-braindamaged way, and fares even worse when compared to all caps.
- NumberCruncher 6y ago> The title is transformed it into an array of numbers between 0 and 1 (each character is a number) and this data is fed (along with the number of points) to the neural network. This sounds strange. But after looking at the authors bio, it isn't strange any more. This has less to do with AI and more with cheap growth hacking.
- timy2shoes 6y agoYeah, this is a classic case GIGO. > Title A: kdjfs;dfisd;diofuosd > Title B: sdlkn nmkd kljdsa;'[ (10% better) > The winner is title B: sdlkn nmkd kljdsa;'[
- thih9 6y agoI had to look up GIGO; "Garbage in, garbage out", https://en.wikipedia.org/wiki/Garbage_in,_garbage_out https://en.wikipedia.org/wiki/Garbage_in,_garbage_out .
- timy2shoes 6y agoConverting text to numbers via individual characters destroys any semantic meaning to the input. Which is why no advanced NLP tools will do such a thing. Basically, what they describe takes whatever meaning is in the title and throws it in a shredder.
- eugenhotaj 6y agoIt's also strange because what they've trained is essentially a recommender system. However, at inference time you're not trying to rank 2 different articles, but the same article with 2 different titles, which I guess you could do, but I'm not sure how well this correlates to your actual ranking on HN. I guess something more interesting would be to take into account the current front page and see how your article would rank against those, or something along these lines. In any case, neat idea.
- nkrisc 6y agoThe predict button doesn't work with the default values.
- timdaub 6y agoA: "Show HN: I built a decentralized data set index" [1] B: rust => B is 66% better. Damn it, I should have used rust! Anyways, great project. Bookmarked! 1: Shameless self-promotion: https://rugpullindex.com https://rugpullindex.com
- arthurcolle 6y agoA: "We predict the future using Erlang VM, and quantum AI blockchains." B: Rust => B is 71% better. Rust is unstoppable, clearly.
- timdaub 6y agoHahahah great meme: A: We cured corona virus B: rust => rust 64% betteer
- johnny_b_g 6y agoI'd just like for HN to have the ability to add a 1-2 line summary with the title - a lot of titles feel like clickbait.
- joshspankit 6y agoOn an iPad (iOS 12), the predict button does not work at all
- colordrops 6y agoI don't know about this tool. Everything beats "JavaScript React Hooks to organize your habits", including "PHP".