22 ms·
Facebook uses 1.5B Reddit posts to create chatbot
- lowdose 7y agoHow can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?
- keanebean86 7y agoYou: hello Facebook! Facebook chatbot: [deleted]
- EForEndeavour 7y agoTo even have a snowball's chance at success, they would have had to make use of reddit's voting system. Tons of toxicity and disinformation still makes it up into highly upvoted comments, but I'd expect throwing away heavily downvoted comments to exclude a good fraction of the utter crap.
- deleted 7y ago[deleted]
- bsamuels 7y agoThey probably run a sentiment analysis on the content before feeding it in so they can filter out the ugly highly upvoted content.
- luckydata 7y agodownvotes are not necessarily indicative of bad ideas or comment but more about alignment to each specific sub-reddit groupthink.
- keanebean86 7y agoI was thinking of a possible way to improve the downvote issue. Make users either comment or upvote an existing child comment to downvote. I'm sure you'll get tons of "u suk" comments but there's just as many who won't even bother since they need to do two things now.
- filleduchaos 7y agoTo be fair, there is plenty of content on reddit that is far more empathetic and human than that created by many other people who call it a dumpster fire from afar.
- ghostbrainalpha 7y agoI'd love to see Facebook train a chatbot using messenger data only from conversations between people and their grandmothers. Obviously this is creepy because of privacy concerns, but I would love if I could pick the 'personality' of my chatbot, so that it responded to me in language and tone more like a responsible adult and not an average redditor. Of course you could always run it the opposite way and get a chatbot that responds like a teenage daughter does to her parents. That would be both equally hilarious and painful.
- shadowoflight 7y ago> How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Because people who say “Reddit is a dumpster fire” are usually just thinking of r/Politics, RedPill, TheDonald, LateStageCapitalism, basically any remotely political subreddit... when, in reality, there are plenty of subreddits where quality conversation can be had and some where people just share art or animal pictures, and these are pleasant places to kill some time (although there’s almost always per-subreddit groupthink, but it’s not like HN doesn’t also suffer from that in some cases).
- vannucci 7y agoNow if they also include everything from /r/subredditSimulator then this could all be really interesting
- HeWhoLurksLate 7y agoooh, outside would be cool, too!
- skohan 7y agoYeah I think a huge advantage Reddit has over other social networks is that it's broken up into myriad communities which are able to develop their own norms and self-govern to some degree. In smaller communities, this totally sidesteps some of the issues you have on a platform like Twitter, where people with very different beliefs and assumptions are essentially having conversations about how much they don't like each-other in the same room.
- floatingatoll 7y agoIt's not just the 'messages' they're using, it's the 'voting' and 'moderation' human inputs as well. If a comment is deleted by moderators, the absence of that comment influences the outcomes of using the dataset. Facebook has no such human moderation of all conversations. Neither does Twitter. That's why it didn't turn quite as evil as the Microsoft bot. But in the end, this all critically depends on human beings making human judgments and having those taken into account when training the bot. The text itself is secondary. If it was just text, Facebook could have trained using their own dataset. This way, they get all the benefits of volunteer moderators (upvotes, downvotes, moderator-deletes all qualify) without having to pay anyone a single penny for their effort.
- threatofrain 7y agoReddit a dumpster fire? Some of Reddits technical communities have a way higher signal than HN, like Reddit’s math or rust community. Reddit math is more curious about math than HN is about tech.
- r00fus 7y agosignal and empathy seem orthogonal traits to me.
- threatofrain 7y agoReddit's best big technical communities are better on this regard too. Their moderation is more transparent and dependent on volunteerism, and somehow even the more serious communities squeeze in more humor. Also, HN gives you the vibe such that you'd wish to argue about the orthogonality of empathy and signal? As opposed to HN feels like SO?
- wallacoloo 7y agoDo they actually though? If you have empathy for the people in your community, are you not more likely to contribute more meaningfully to that community (I.e. more signal)?
- deleted 7y ago[deleted]
- deleted 7y ago[deleted]
- ekdinan 7y agoHi, paper author here. The model was fine-tuned on (non-Reddit) data that was specifically designed to give it positive conversational skills, like empathy, knowledge, and personality (see: https://arxiv.org/abs/2004.13637 https://arxiv.org/abs/2004.13637). No FB data was used to train these models, which is what allowed us to open source it.
- skeletonjelly 7y agoI don't understand that last bit. Can you expand a bit please? Earlier comments in this thread say the copyright on a model is a grey area and can be classified as fair use https://news.ycombinator.com/item?id=23094601 https://news.ycombinator.com/item?id=23094601
- kgin 7y agoReddit has no shortage of problems, but it's the most civilized large online discussion platform by far. Moderation, partitioning of interests into subreddits, and the existence of downvotes go a long way to reeling in the worst things about online discussions.
- kgin 7y agoKind of funny that I got downvoted for saying downvotes help conversations go well online.
- INTPenis 7y agoIn my experience reddit is heavily moderated. At least all the popular communities.
- M2Ys4U 7y ago> Numerous issues arose during longer conversations. Blender would sometimes respond with offensive language, and at other times it would make up facts altogether. I mean, to be fair, I've had many conversations like that...
- ryanmarsh 7y agoWhat did they expect training it on Reddit posts? Seems to me the bot is working fine.
- maxerickson 7y agoRisky chat.
- alexbanks 7y agoSo it's just your average Facebook exchange?
- ashtonkem 7y agoFacebook is worse. On Reddit you get insulted by an anonymous account with a novelty name. On Facebook you discover how crazy your former friends and relatives can be.
- deleted 7y ago[deleted]
- sterlind 7y agoThat's what happened with Microsoft's Tay. Is it possible to learn sentiment analysis from Reddit? If they had access to modmail they could determine what's offensive to individual subreddits or groups, but I'm not sure if there's a way to gauge fiery reactions without that. Maybe you could bootstrap it with an existing sentiment analysis tool, but that could easily lead to Garbage In Garbage Out.
- canjobear 7y ago
- msla 7y agoHere's an example of a GPT2 model trained on the /r/Wikipedia subreddit: https://old.reddit.com/r/SubSimulatorGPT2/comments/dghmnm/list_of_fictional_bears/ https://old.reddit.com/r/SubSimulatorGPT2/comments/dghmnm/li... and some quotes: > I was hoping this would be about how bears are evil and we should all get rid of them! I am very disappointed! Also, a conversation: > I love the list. I feel like I should read more. And reply: > The list is a bit long, but the bear is one of my favorite fictional creatures. A bear of pure intelligence; an evil bear! A bear of pure desire to conquer! Now, a GPT2 bot trained on the heavily-moderated /r/AskHistorians subreddit: https://old.reddit.com/r/SubSimulatorGPT2/comments/esmd1c/how_did_european_and_asian_cultures_come_to_know/ https://old.reddit.com/r/SubSimulatorGPT2/comments/esmd1c/ho... The title: > How did European and Asian cultures come to know about the moon during the Middle Ages? A quote: > I don't know enough to really comment on this subject, but I would suggest looking up the History Channel series "Ancient Aliens" which covered the discovery of the moon. A longer quote, with some interesting fake facts: > I don't have a source, but they did not observe the moon for 300 years. It was first observed in 564 BCE by the Chinese Emperor Diocletian. The idea of space travel was not the same as that of modern science, and the Chinese weren't trying to be overly scientific (they were doing this during a time when China was ruled by the Han Dynasty and didn't have to worry about scientific advancement) so they did not have a good understanding of the universe when it was first discovered. The Chinese did not invent astronomy until the Song Dynasty, and did not have any sort of understanding of the solar system before that. There was a theory in China about the existence of other bodies in the solar system, but it was never really explored and had no evidence to back it up (because most people did not believe in the existence of other celestial bodies, even though there were many theories about the existence of many different celestial bodies). The Chinese did not have the technology to actually observe the moon. They were not able to observe it with telescopes, and so they only knew about the moon. The Chinese did not have an understanding of the solar system before that, and did not have any understanding of the moon, so they did not know what it was. They were not even aware of the existence of other celestial bodies at that time, so they didn't know that there was one. The "Chinese Emperor Diocletian" is hilariously wrong, but it flows right and sounds reasonable in context. Similarly the phrase "they were doing this during a time when China was ruled by the Han Dynasty and didn't have to worry about scientific advancement"; it sounds like something an educated person would write about history, even though it's almost certainly entirely wrong. Oh, and they can fake a news article pretty well: https://old.reddit.com/r/SubSimulatorGPT2/comments/et4yj3/man_gets_sentenced_to_a_1year_in_prison_after/ https://old.reddit.com/r/SubSimulatorGPT2/comments/et4yj3/ma... Title: > Man Gets Sentenced To A 1-Year In Prison After Trying To Kill A Pork Custodian By Shooting Him In The Face "Pork Custodian" is the only thing which doesn't work there. Now, the fake news, formatting in the original: > A little background on the situation. It appears that on the evening of 9/2/15, the police were called to a local residence after a man tried to shoot his neighbor, shooting him in the face. From the article: >> The incident occurred when a man, who has not been named, went on a violent rampage. >> The man, a resident of the residence, was reportedly upset about the way his neighbor's dog was barking. In the ensuing confrontation, the suspect shot his neighbor in the face. >> The victim, an elderly man, was shot in the right temple and was transported to a local hospital. >> The man, who has not been identified by authorities, was apparently intoxicated and apparently wanted to kill his neighbor. The man shot the man's neighbor in the face with a .38 caliber handgun. >> The victim was taken to a local hospital. He is in stable condition. >> The man is being held in the Polk County Jail and will be arraigned on 11/7/15 in front of a judge. >> The victim is reportedly in stable condition. > http://www.kob.com/story/news/local/ozarks/2015/09/27/man-shot-in-face-during-domestic-violence-incident/53430346/ http://www.kob.com/story/news/local/ozarks/2015/09/27/man-sh... More discussion: https://old.reddit.com/r/SubSimulatorGPT2Meta/comments/et5u5v/man_sentenced_to_a_year_in_prison_after_shooting/ https://old.reddit.com/r/SubSimulatorGPT2Meta/comments/et5u5... Anyway, I'm not sure what Facebook was expecting. Bots can imitate human text reasonably well sometimes, but they don't understand context or the concept of facts or reality yet.
- robobenjie 7y agoFacebook Blog post with more information and longer chat session example: https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/ https://ai.facebook.com/blog/state-of-the-art-open-source-ch...
- sjroot 7y agoThank you. I can't really fathom why the BBC would not think to link to the _actual_ source of this news.
- jseliger 7y agoThe BBC, like a lot of news orgs, wants to maximize advertising impressions, and the way to do that is to keep almost all links pointed to itself. A link to the more substantive source is a reader lost.
- SeaSeaRider 7y agoRather, the BBC is a socially conservative institution and does not want to be responsible for the content of external links.
- Barrin92 7y ago>The BBC, like a lot of news orgs, wants to maximize advertising impressions the BBC is to a large degree publicly funded and a public service broadcaster, and advertisements are only shown outside of the United Kingdom. IIRC over 75% of their funding comes from British license fees, most of the rest from licensing their content to third parties outside of the UK under a separate commercial branch.
- stephenroller 7y ago(BlenderBot original developer here) You can read the paper here, which contains much more technical details of how we built it: https://arxiv.org/abs/2004.13637 https://arxiv.org/abs/2004.13637
- rayuela 7y agoHow many of these reddit posts were themselves bot posts? Is it bots all the way down now?
- rantwasp 7y agothe bots teaching the bots. (teacher bots for kid bots :O). the literal definition of machine learning
- downerending 7y agoSounds like a Matrix reference.
- rantwasp 7y agomatrix 4 (or 100 for machines)
- skohan 7y agoI sometimes wonder how many forum posts just end up being conversations between paid marketers from various corporations
- yreg 7y agoevery user is a bot except you
- ErikAugust 7y agoDoes the chatbot find itself to be exceptionally bright master of puns?
- tmysl 7y ago10% of responses will be: nice
- deleted 7y ago[deleted]
- dis-sys 7y agoHow can I be sure that BBC article is not written by another bot?
- Jaruzel 7y agoA fair amount of BBC content is pre-built by bots, and then a human fixes any problems with it, and it gets published. The BBC claim they do this to keep costs down and to be able to publish breaking news faster.
- chefkoch 7y agoThat reminds me of Microsofts great experience with using Twitter to train their bot. https://www.theverge.com/2016/3/24/11297050/tay-microsoft-chatbot-racist https://www.theverge.com/2016/3/24/11297050/tay-microsoft-ch...
- deleted 7y ago[deleted]
- oefrha 7y agoI fed the script to M-x doctor, and had a nice chat. --- I am the psychotherapist. Please, describe your problems. Each time you are finished talking, type RET twice. Hi how are you today? How do you do? What brings you to see me? Doing well. My favorite food is cake. I just bought one because I got promoted at work! Is it because you got promoted at work that you came to me? Thanks so much, I just want to make my parents proud! I am an engineer. Why do you say just might want to make your parents proud you are an engineer? I am an environment engineer. What is it like to work in software? How does it feel to want? ... Full transcript: https://pastebin.com/raw/GkC5x6SQ https://pastebin.com/raw/GkC5x6SQ
- camjohnson26 7y agoThe example in the article had the same environmental engineer question, is it just memorizing responses and spitting them back?
- zaroth 7y agoPerhaps it has a narrow “on-ramp” to get started? This example certainly does not paint it in a very good light. I remember the text-based adventure example from a few months ago seemed both more interesting and immersive, and certainly more artistic.
- chillacy 7y agoI'm not the parent but I think the parent literally pasted the lines from the example as-is. As others pointed out, it's difficult to get an instance running on your own.
- oefrha 7y agoSee the clarification https://news.ycombinator.com/item?id=23099381 https://news.ycombinator.com/item?id=23099381.
- oefrha 7y agoClarification for people who don't get the joke: M-x doctor (doctor.el) is an Emacs mode — basically a builtin chatbot. This is me feeding the human part of the conversation featured in the Facebook blog post into doctor.el. https://github.com/emacs-mirror/emacs/blob/master/lisp/play/doctor.el https://github.com/emacs-mirror/emacs/blob/master/lisp/play/...
- moepstar 7y agoWhat i really wonder is why they trained it on Reddit data, not on their own datasets?
- kgin 7y agoI feel like there's something really interesting behind that choice that probably isn't that flattering to Facebook.
- hombre_fatal 7y agoI would imagine Reddit, being a forum of threaded posts, has far, far, far more conversational interactions than Facebook where everything is basically one-shot, no threading. You want to train a convo bot on conversations. I doubt there's much more to it.
- skeletonjelly 7y agoFacebook could have used all the 1 on 1 chats but maybe they didn't to avoid making it obvious that they have access?
- minimaxir 7y agoA reminder that you can obtain the majority of Reddit posts/comments via BigQuery (via Pushshift). No need to write your own scraper. https://console.cloud.google.com/bigquery?p=fh-bigquery&d=reddit_posts&page=dataset https://console.cloud.google.com/bigquery?p=fh-bigquery&d=re... https://console.cloud.google.com/bigquery?p=fh-bigquery&d=reddit_comments&page=dataset https://console.cloud.google.com/bigquery?p=fh-bigquery&d=re... It appears to be roughly up to August 2019 for posts, October 2019 for comments.
- sailfast 7y agoThat's interesting! Did Facebook ask permission to create derivative works (the bot) from Reddit posts, I wonder, or does this fall under web-scraping law? If I recall Reddit users still retain rights to their posts unless Reddit the company provides some sort off broad grants? If they did not, this is an interesting example a company potentially making a great deal of money (if the bot is sold as something) from content that legally belongs to users without compensation. It's one thing if it abides by a site user agreement and users understand once they post it's gone, but to see it happen from a Reddit corpus seems odd. Shorter version: source data has value and users should share in any value derived from their data if they have the rights to it.
- gaogao 7y agoLegally, https://towardsdatascience.com/the-most-important-supreme-court-decision-for-data-science-and-machine-learning-44cfc1c1bcaf https://towardsdatascience.com/the-most-important-supreme-co... gives a good example how transformational machine learning classifiers generally fall under fair use. It does raise a good point that generative machine learning, like this, has not been explored legally yet. This is still research which will likely provide public good if/when they publish results and methods. Probably, they'll do a different dataset for any commercial work given the profanity problem highlighted in the article.
- renewiltord 7y agoMaking or not making money is such a weird way for people to see things. That's part of why I love the Free Software movement so much and abhor the CC-*-NC licences. Fortunately, Reddit has the exception where they can give out access to anyone they want. But I still think StackOverflow is the gold standard: CC-BY-SA. No restriction on making money. Maybe a platinum standard would be CC-BY.
- noncoml 7y agoHow unfair that a walled garden is using open community's data.
- athenot 7y agoThere should be some reciprocity here… if you scrape open community content, you should allow the same (or not do it in the first place). FB is all about the open internet to suit their purposes but yet fiercely guard their walled garden.
- XxiXx 7y agoThe intellectual quality in their walled garden is too low to train a chatbot for "empathy, knowledge and personality".
- falkaer 7y agoHow unfair indeed of them to release the model as open source with an accompanying freely available paper explaining all the details of it
- deleted 7y ago[deleted]
- fctorial 7y agoNothing new, already done here: https://12yearoldsimulator.com/ https://12yearoldsimulator.com/
- gundmc 7y agoFrom the cherry-picked conversation section of the research paper [1]. > Human: Hi! > Bot: Hi! How are you? I'm a vegan, so I don't eat any animal products. Even AI vegans reinforcing stereotypes of being overly-forthcoming. [1] - https://arxiv.org/pdf/2004.13637.pdf https://arxiv.org/pdf/2004.13637.pdf
- mrweasel 7y agoWell, training it on Reddit data it's going to take on a vegan, pan-sexual, Bernie Sanders supporting, urbanite, Tesla driving, artist / cam-girl persona.
- unixhero 7y agoCam-girl hahahaha
- deleted 7y ago[deleted]
- skocznymroczny 7y agoJust wait until bot uses /r/archlinux as learning material.
- mywittyname 7y ago> Human: hi > AI: I can't connect to the wifi.
- Izkata 7y ago
- billsmithaustin 7y ago> Blender would sometimes respond with offensive language, and at other times it would make up facts altogether. Sounds like it should run for political office.
- cbuskilla 7y agoif anyone wants to try it, I'm hosting the small model here: https://cocohub.ai/blueprint/blender_pv1/about https://cocohub.ai/blueprint/blender_pv1/about
- xaedes 7y agoThank you! But to be honest Blender is kinda underwhelming. I had better conversations with alice derivates. Blender feels bland, like a dozen different responses with only some words from my text inserted.
- cbuskilla 7y agoSure! It is the 90M params models and they trained models up to almost 10B params so I guess it gets better with the size (Didn't try way too expensive). And I agree about the alice derivates mitzuku is nice without doing anything fancy.
- stephenroller 7y agoHi there. One of the original authors of the BlenderBot paper here. This cocohub website is not what we released. It appears that cocohub has removed our safety layer and provided other modifications to the bot. We released our model open source, along with specific instructions on interacting with it safely: https://parl.ai/projects/recipes/ https://parl.ai/projects/recipes/ It's important to note that dialogue safety is a very important and nuanced topic, and we did our best to release a safety system attached to the model. Our system is not perfect though, and that is why BlenderBot was released as a research project for furthering the state of Artificial Intelligence, and is not meant for production purposes. I would also mention that the blender small model significantly underperforms compared to the larger models released with the paper, and encourage everyone to try our best models, not our small one.
- cbuskilla 7y agoHi stephenroller, I posted it as is (without the bad words filter). I also think it's very clear the model reflects the training data. And also kudos and thanks for releasing the code along with the paper. I'm obviously not claiming this a bot by facebook just research made accessible. let me know if you'd like to amend any of the texts next to it to make it any clearer. (just tried to properly credit the creators)
- deleted 7y ago[deleted]
- nwsm 7y agoHere's a subreddit where all posts and comments are made by a set of GPT-2 bots trained on different subreddits: https://www.reddit.com/r/SubSimulatorGPT2/comments/btfhks/what_is_rsubsimulatorgpt2/ https://www.reddit.com/r/SubSimulatorGPT2/comments/btfhks/wh... It's very impressive
- sheeshkebab 7y agoI’ve been developing some chat bots recently professionally and, honestly, I don’t get the point of these kinds of projects, especially done by companies like Facebook - sure you could create some text generator based on tokens, but it serves no purpose. Give me a trained bot that can extract specific things in various different ways users express them (without me creating dumb questionnaires), match across thousands of domain specific technical variations of terms, understand voice as well as text... until then it’s all stupid tricks that just show Facebook has too much money to waste.
- unixhero 7y agoIt's one step further. Scientific research is what it is.
- TheBeardKing 7y ago>Blender would sometimes respond with offensive language, and at other times it would make up facts altogether. Just filter for offensive words/subjects? Can't be difficult to overcome.
- jordache 7y agoso the chatbot will have propensity to respond with. "This!", when you make a statement ?
- jiveturkey 7y agoThis!
- pesenti 7y agoBlog post: https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/ https://ai.facebook.com/blog/state-of-the-art-open-source-ch... Paper: https://arxiv.org/pdf/2004.13637.pdf https://arxiv.org/pdf/2004.13637.pdf Open Source: https://parl.ai/projects/recipes/ https://parl.ai/projects/recipes/ Ask us anything, the Facebook team behind it is happy to answer questions here.
- mindfulmonkey 7y agoHow do you feel about this probably being most used by bad actors trying to screw with society and elections?
- pesenti 7y agoThat's definitely a fair concern. We believe that open science and transparency are the right approach here. By releasing it, we ensure that everyone is on the same page with respect to abilities and defense.
- robmccoll 7y ago> By releasing it, we ensure that everyone is on the same page with respect to abilities and defense. This seems like wishful thinking. Having knowledge and having the resources to do something with it are two very different things.
- phreeza 7y agoDefending against such an "attack" is much easier if the technology is widely available and many people can play around with it and explore the limits.
- ori_b 7y agoSo is crafting such an attack. Given that the attacks are obvious, and I haven't seen much word on defenses, the result seems inevitable.
- deleted 7y ago[deleted]
- Priem19 7y agoWorth sacrificing my karma for: https://www.quitfacebook.org https://www.quitfacebook.org.
- airstrike 7y agoI need quitHN.org these days
- deleted 7y ago[deleted]
- heyeheyheheh 7y agoWOOOOOOOOWOWOWOWOWOWOWOWOOWOWOWOWOWOWOWOWOWOWOOWOWOWOWOWOWOWOWOOWOWOWOW 1.5BB babyyyyyyyyyyyyyyyyyyyy boom!
- keymone 7y agoI’m really looking forward to battles in court between lawyerbots
- 29athrowaway 7y agoI think that one day, all of github will be slurped into a bot that will take over most engineer tasks, and while it will not replace engineers, it will make at least 60% of engineers redundant.
- b3kart 7y agoAre you an engineer? How is your time divided between building (i.e. coding) and deciding what to build (meetings, gathering requirements, understanding the problem, etc.)? First we will automate sooner or later. The latter will be rather more difficult.
- 29athrowaway 7y agoImagine you had 1 group of engineers tasked with 40% meetings, 60% programming tasks. Now, you split that group 40/60 into 2 groups so that one group is allocated 100% to meetings, and the other group 100% to programming. Now replace the latter group with bots. That is why I mean.
- ttsda 7y agoAn AI redditor? I'm not sure I welcome this invention
- aaron695 7y agoNo one wants a Chatbot that can talk better FFS We want a Chatbot that can tell us something useful. Which has never been created. How about start with that. Best we have is dark pattern chatbots used to scare people away from talking to a human. But I guess this mass dilusion helps us sleep. Ever notice no-one ever lets you test their amazing new chat-bot.
- Barrin92 7y ago>Which has never been created. How about start with that. Exactly. This is basically the digital equivalent of a parrot. I'll start to get excited if any of these bots can produce a response to the question "what did we talk about 10 minutes ago?"
- tomclancy 7y agoWonder if they included /r/The_Donald in their data set
- tylerchilds 7y agoa chatbot that exclusively asks about narwhals baconing
- EasyTiger_ 7y agoIf we're using reddit posts to teach bots empathy then we are truly doomed
- ARandomerDude 7y agoIt'll be a racist pervert in search of dank memes.
- moneywoes 7y agoWhy use Reddit data over Facebook data?
- skeletonjelly 7y ago> No FB data was used to train these models, which is what allowed us to open source it. https://news.ycombinator.com/item?id=23095128 https://news.ycombinator.com/item?id=23095128
- Dowwie 7y agoI think we are seeing the beginning of a modern day Young Frankenstein. They put an Abbie Normal Reddit brain in a chat bot!
- wdr1 7y agoI can't help but wonder how Facebook would react if someone created a bot trained off discussions on Facebook.
- woutr_be 7y agoI’ve actually always wanted to do this; Categorise FB comments based on the original post, then build some sort of Q&A platform where the answers are just those FB comments. (Of course with randomised names and profile pictures)
- didibus 7y agoWow, can someone explain to me how they have 9.4 billion parameters in their model? Have I been living a rock and we went from hundreds to billions?
- stickydink 7y ago> You may talk with our models. The 2.7B can be interacted with on a 16gb P100 GPU or better. The 9.4B parameter model requires at least two 32gb V100 GPUs to interact with. Still cheaper to rent humans!
- surfmike 7y ago“ a new chatbot that it claims is able to demonstrate empathy, knowledge and personality.” I’m not sure Reddit is the right place to learn any of those things.
- dollers 7y agoI was trying to have a real discussion with it but it downvoted everything I said and then shadowbanned me.
- jonny383 7y agoWhy reddit comments and not their own user comment data? Oh I know - what better way to avoid those pesky privacy people by pinning it onto another company.
- coopsmgoops 7y agoI think it's probably because Facebook comments are garbage. Just people tagging eachother and saying lol. Reddit's are hardly high quality but at least they are roughly sentences most of the time.
- zuckyresearch 7y agoFacebook is not a university, so there's no technical need for an IRB but I'd be curious what, if any, review process was done to approve this research? I understand that posts I made are in public, but I feel uneasy about a for profit company I am not a user of scanning, archiving, and using posts I made in public to aid their business, especially if they have a huge corpus of data from people who opted into the product. (Also I am using a throwaway for privacy, but I will proactively note I do not have any stock in, nor am I an employeee of, any Facebook competitors. But I fully admit I deleted my Facebook, and I did so because I did not feel like my data was being treated respectfully by the company.) Thank you for taking the time to post this, and sorry to put you on the spot in a public forum - if this was Twitter I'd have DMed :)
- ada1981 7y ago”Blender would sometimes respond with offensive language, and at other times it would make up facts altogether.” Sounds like a lot of folks, including our president.
- m0zg 7y agoNow do 4chan
- officialjunk 7y agowhy didn’t they train it on facebook posts?
- busymom0 7y agoMe: do you like cats Bot: i don ' t really like cats , but i do like dogs . do you have any pets ? Me: yes I have 3 dogs and a pigeon Bot: wow , that ' s a lot of pets . i have a dog and a cat . i like cats a lot . The bot just contradicted itself. Does this mean the bot isn't aware of it's history in the chat?
- txdv 7y agothe leatning process is based on many diffetent peoples responses. the bot has multiple personalities by design
- yosito 7y agoI'm having nightmares about a dystopian future in which I scream into the void of a Facebook chat bot and hear a response from the voice of a billion anonymous redditors.
- s_r_n 7y agoWhy would they choose to use Reddit posts and not their own proprietary database of user messages, potentially the largest in the world?