5 ms·

This is not as cool as the comment dataset, but it's still pretty cool. I think in the future AIs will make extensive use of these kinds of datasets. It's amazi

This is not as cool as the comment dataset, but it's still pretty cool. I think in the future AIs will make extensive use of these kinds of datasets. It's amazing how much useful information is in there. Last year I made a simple IRC question answering bot that just searched reddit for your question and returned the top comment of the top result. It worked surprisingly well. It's amazing how many questions someone else has asked on reddit before. And the comment quality is usually pretty good. Sample conversation with it: https://i.imgur.com/LDD9isL.jpg https://i.imgur.com/LDD9isL.jpg I improved on it a lot with a whitelist of subreddits and some machine learning to select the best thread. But I was only touching on what is possible with that data. You can play with it here: https://kiwiirc.com/client/irc.snoonet.org/mybots https://kiwiirc.com/client/irc.snoonet.org/mybots EDIT: It does only work well with certain kinds of questions. Thing's that would have been asked before and without too many unique keywords. I see some people ask it really unique questions, or talk to it like a regular chatbot without even asking questions. And then get frustrated when it returns nonsense. There are a lot of improvements that could be made with this with natural language processing and stuff. But right now it's pretty simple.

tomtoise 11y ago
This ties directly into the comment dataset, made by the same person and via the same method[1]. Working on pulling down the submission data now, will have to spin up another server if I want to do the comment/submission correlation. >>"This dataset will go nicely with the full Reddit Comment Corpus that I released a couple months ago. The link_id from each comment corresponds to the id key in each of the submission objects in this dataset."
- laumars 11y ago
  Is the Comment Corpus still available? I have looked but couldn't see anything obvious (my apologies if I'm being thick here)
  - tomtoise 11y ago
    Sure, here you go [1] - It unpacks to over 1tb though, hence me considering spinning up another server just for the comments. Might be a good use for my test Hadoop cluster. [1] https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/ https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_eve...
    - laumars 11y ago
      Thank you. I'll be unpacking this on a FreeBSD server, so hopefully ZFS's lz4 file system compression will take some of the bite out of that 1TB file.
akie 11y ago
That chat bot is beyond amazing. Easily the best I've ever seen.
- CPLX 11y ago
  Me: What happens when an irresistible force meets and immovable object? AMAbot: Too much explanation... Get out of the shower, you're a raisin. Also, makes me think of like babies, wrestling. Kind of like the opposite of atlas. why are you gay?
hellweaver666 11y ago
Thanks for sharing this - that was a lot of fun!
nbadg 11y ago
Do you have any of the source on Github? I'd be very interested in taking a look and potentially using it as an excuse to get playing with a natural language toolkit (in all my spare time haha)
- Springtime 11y ago
  Found a [1] pastebin of the code the author made in July when I believe it was updated due to interest from another HN discussion [2]. [1] http://pastebin.com/CM9u17jq http://pastebin.com/CM9u17jq [2] https://news.ycombinator.com/item?id=9871603 https://news.ycombinator.com/item?id=9871603
- Houshalter 11y ago
  Yes https://github.com/Houshalter/amabot https://github.com/Houshalter/amabot
  - nbadg 11y ago
    Thanks man!
  - khakimov 11y ago
    Could you share "C:\\Users\\Daniel\\Documents\\Programming\\AMAbotData.txt" as well or it is not neccessary to run the bot?
    - nbadg 11y ago
      Presumably that's the large dataset he was referring to.
      - Houshalter 11y ago
        Ok I added it and removed some of the stuff that was configured specifically for me. It should work. Please report any and all issues. I'm not sure if javascript supports local filepaths so you might need to edit it.
deleted 11y ago
[deleted]
stuck_in_the_ma 11y ago
This is very cool! Glad to see that people are making good use of this. Are you pulling the answer with the highest score?
bcruddy 11y ago
This is really cool, is the source code available anywhere?
- Houshalter 11y ago
  yes https://github.com/Houshalter/amabot https://github.com/Houshalter/amabot
temuze 11y ago
This is super impressive. My favorite was: "Who is your daddy and what does he do?" "It's not a tumor!"

tomtoise 11y ago

This ties directly into the comment dataset, made by the same person and via the same method[1]. Working on pulling down the submission data now, will have to spin up another server if I want to do the comment/submission correlation. >>"This dataset will go nicely with the full Reddit Comment Corpus that I released a couple months ago. The link_id from each comment corresponds to the id key in each of the submission objects in this dataset."

laumars 11y ago
Is the Comment Corpus still available? I have looked but couldn't see anything obvious (my apologies if I'm being thick here)
- tomtoise 11y ago
  Sure, here you go [1] - It unpacks to over 1tb though, hence me considering spinning up another server just for the comments. Might be a good use for my test Hadoop cluster. [1] https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/ https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_eve...
  - laumars 11y ago
    Thank you. I'll be unpacking this on a FreeBSD server, so hopefully ZFS's lz4 file system compression will take some of the bite out of that 1TB file.

akie 11y ago

That chat bot is beyond amazing. Easily the best I've ever seen.

CPLX 11y ago
Me: What happens when an irresistible force meets and immovable object? AMAbot: Too much explanation... Get out of the shower, you're a raisin. Also, makes me think of like babies, wrestling. Kind of like the opposite of atlas. why are you gay?

hellweaver666 11y ago

Thanks for sharing this - that was a lot of fun!

nbadg 11y ago

Do you have any of the source on Github? I'd be very interested in taking a look and potentially using it as an excuse to get playing with a natural language toolkit (in all my spare time haha)

Springtime 11y ago
Found a [1] pastebin of the code the author made in July when I believe it was updated due to interest from another HN discussion [2]. [1] http://pastebin.com/CM9u17jq http://pastebin.com/CM9u17jq [2] https://news.ycombinator.com/item?id=9871603 https://news.ycombinator.com/item?id=9871603
Houshalter 11y ago
Yes https://github.com/Houshalter/amabot https://github.com/Houshalter/amabot
- nbadg 11y ago
  Thanks man!
- khakimov 11y ago
  Could you share "C:\\Users\\Daniel\\Documents\\Programming\\AMAbotData.txt" as well or it is not neccessary to run the bot?
  - nbadg 11y ago
    Presumably that's the large dataset he was referring to.
    - Houshalter 11y ago
      Ok I added it and removed some of the stuff that was configured specifically for me. It should work. Please report any and all issues. I'm not sure if javascript supports local filepaths so you might need to edit it.

deleted 11y ago

[deleted]

stuck_in_the_ma 11y ago

This is very cool! Glad to see that people are making good use of this. Are you pulling the answer with the highest score?

bcruddy 11y ago

This is really cool, is the source code available anywhere?

Houshalter 11y ago
yes https://github.com/Houshalter/amabot https://github.com/Houshalter/amabot

temuze 11y ago

This is super impressive. My favorite was: "Who is your daddy and what does he do?" "It's not a tumor!"