7 ms·
Hey HN! I've been lurking for a while now and I've finally created something that I feel is worth sharing. I've called this project "Tensorpedia." At its core,
by JonahSussman 5y ago
Hey HN! I've been lurking for a while now and I've finally created something that I feel is worth sharing.
I've called this project "Tensorpedia." At its core, Tensorpedia takes in a title and utilizes it as a prompt for GPT-2 to synthesize the introductory part of a Wikipedia article. The machine learning stuff is written using a wonderful library called aitextgen [0], using Wikipedia's "Vital Articles" as a data set [1]. The server is written in Node, and it uses Redis as an article cache. If you want to read my article about it (for some reason), you can check it out here [2].
I created this project to get more experience with server technologies. While I wouldn't say it's a complicated application, I learned quite a lot from it.
Additionally, as I was inspired by all of those this-x-doesn't-exist projects from a while back, this project is mostly for fun. As such, I don't know how much practical use it has, but I've generated some pretty hilarious articles from it.
[0] https://github.com/minimaxir/aitextgen https://github.com/minimaxir/aitextgen
[1] https://en.wikipedia.org/wiki/Wikipedia:Vital_articles/Level/4 https://en.wikipedia.org/wiki/Wikipedia:Vital_articles/Level...
[2] https://jonahsussman.net/posts/2022-01-this-wiki-dne/ https://jonahsussman.net/posts/2022-01-this-wiki-dne/
- LargoLasskhyfv 5y agoEvil! :-) Have you thought of feeding it facts from https://www.wikidata.org/ https://www.wikidata.org/ and let it construct articles that way?
- JonahSussman 5y agoI thought about using wikidata, but I'm not quite sure how I would feed it into the neural network. It's definitely a possibility though!