3 ms·
Show HN: Tensorpedia – Using GPT-2 to synthesize Wikipedia articles
- JonahSussman 5y agoHey HN! I've been lurking for a while now and I've finally created something that I feel is worth sharing. I've called this project "Tensorpedia." At its core, Tensorpedia takes in a title and utilizes it as a prompt for GPT-2 to synthesize the introductory part of a Wikipedia article. The machine learning stuff is written using a wonderful library called aitextgen [0], using Wikipedia's "Vital Articles" as a data set [1]. The server is written in Node, and it uses Redis as an article cache. If you want to read my article about it (for some reason), you can check it out here [2]. I created this project to get more experience with server technologies. While I wouldn't say it's a complicated application, I learned quite a lot from it. Additionally, as I was inspired by all of those this-x-doesn't-exist projects from a while back, this project is mostly for fun. As such, I don't know how much practical use it has, but I've generated some pretty hilarious articles from it. [0] https://github.com/minimaxir/aitextgen https://github.com/minimaxir/aitextgen [1] https://en.wikipedia.org/wiki/Wikipedia:Vital_articles/Level/4 https://en.wikipedia.org/wiki/Wikipedia:Vital_articles/Level... [2] https://jonahsussman.net/posts/2022-01-this-wiki-dne/ https://jonahsussman.net/posts/2022-01-this-wiki-dne/
- LargoLasskhyfv 5y agoEvil! :-) Have you thought of feeding it facts from https://www.wikidata.org/ https://www.wikidata.org/ and let it construct articles that way?
- JonahSussman 5y agoI thought about using wikidata, but I'm not quite sure how I would feed it into the neural network. It's definitely a possibility though!
- Weryj 5y agoI had some good fun reading some of these articles. Absolutely absurd
- JonahSussman 5y agoI had a good chuckle putting my colleague's names in it - everyone was a superstar, famous poet, or swimmer of some sort. Any good ones you wouldn't mind sharing?
- Weryj 5y agoI tried Josh and quite liked "She married Abraham Van Helsing in 1849 and was the only woman to win a Henry VI throne that year."
- meepmorp 5y agoThis is my favorite new thing of the day. Thanks!
- JonahSussman 5y agoThank you so much! Glad it brought you some enjoyment!
- iggldiggl 5y agoGreat idea, although it's a bit annoying that none of the article links works as an actual link, so I can't easily open pages in a new tab like I often do when reading a Wikipedia article.
- JonahSussman 5y agoThat's actually a fantastic idea! I'll add it in my next update
- iggldiggl 5y agoI see it's already live, thanks very much.