5 ms·

I was really blown away by the results you achieved. Amazing work! My jaw hit the floor when I saw the witty farewell "fun guy" quip, and I was in stitches when

I was really blown away by the results you achieved. Amazing work! My jaw hit the floor when I saw the witty farewell "fun guy" quip, and I was in stitches when I read the song about baking. I look forward to the day I can take the model for a spin - unfortunately I don't have the requisite $18,000 hardware ;) I have a few questions: Could this be used as a tool to get a feel for public sentiment? For example, could you ask the bot what it thinks about gun control and have it spit out a policy that appeals to the common public? If you ask the bot what it thinks about how a company will perform, how accurately does it predict? I know that the model will contain the biases of the data set, but I'm curious if you've run these types of experiments. What do you think the results would be if you had an even bigger, more diverse corpus? (devil's advocate, for the sake of discussion: perhaps everyone's fb messenger and WhatsApp chat history) Finally, you have clearly gone to great lengths to make the bot pleasant to interact with. What sort of results to you get when you train such a huge model on an uncurated corpus and don't try to tweak its personality? I find myself wishing that you didn't try to do this as the bot seems to be hyper-agreeable. I. E Too many responses like "You like watching paint dry? That's super interesting! I love watching paint dry!".

stephenroller 6y ago
I would not encourage using the model for anything other than AI research -- we're still in the early days of dialogue, and there are a lot of unexplored avenues. There are still nuances around safety, controlling generation, consistency, and knowledge involvement. For instance, the bot cannot remember what you said even a few turns ago, due to limitations in memory size. In the paper, we did explore what happens when you do NOT fine tune it on the specialized tasks (knowledge, empathy and personality). The non-finetuned bot was both less engaging and more toxic. The special finetuning is really important to getting this bot to be as high quality as it is.
- Cakez0r 6y ago
  But toxicity and quality is subjective. The technical achievement is undeniably brilliant, but the quality of the personality is subject to opinion - as I mentioned, I did not personally enjoy the agreeability of the bot. What's toxic today may not be toxic tomorrow and vice versa. It's just a matter of time before a model of this size can be run on commodity hardware and somebody will take the brakes off and/or attempt to run experiments that aren't just "can this thing pass the turing test?". I'd be really interested to know the thoughts of the team, given their expert knowledge and experience with the matter.
  - sillysaurusx 6y ago
    For a more toxic version of a similar kind of bot, check out SubSimulatorGPT2: https://www.reddit.com/r/SubSimulatorGPT2/top/?sort=top&t=all https://www.reddit.com/r/SubSimulatorGPT2/top/?sort=top&t=al... Unfortunately you can't talk to it. (I've wanted to retrain a version that you can interact with dynamically, someday.)
    - bkanber 6y ago
      The comment thread on the self-awareness post is both very convincing and really meta. I love how clear the training of the different bots is.
- Cakez0r 6y ago
  Was the bot nonsensical without the fine tuning, or just subjectively a worse conversational partner?
dkdk8283 6y ago
I think the GPU price you’re quoting is about 10k too high. $8500 for the V100/32gb
- Jack000 6y ago
  > The 9.4B parameter model requires at least two 32gb V100 GPUs to interact with plus motherboard, cpu, ram etc.

stephenroller 6y ago

I would not encourage using the model for anything other than AI research -- we're still in the early days of dialogue, and there are a lot of unexplored avenues. There are still nuances around safety, controlling generation, consistency, and knowledge involvement. For instance, the bot cannot remember what you said even a few turns ago, due to limitations in memory size. In the paper, we did explore what happens when you do NOT fine tune it on the specialized tasks (knowledge, empathy and personality). The non-finetuned bot was both less engaging and more toxic. The special finetuning is really important to getting this bot to be as high quality as it is.

Cakez0r 6y ago
But toxicity and quality is subjective. The technical achievement is undeniably brilliant, but the quality of the personality is subject to opinion - as I mentioned, I did not personally enjoy the agreeability of the bot. What's toxic today may not be toxic tomorrow and vice versa. It's just a matter of time before a model of this size can be run on commodity hardware and somebody will take the brakes off and/or attempt to run experiments that aren't just "can this thing pass the turing test?". I'd be really interested to know the thoughts of the team, given their expert knowledge and experience with the matter.
- sillysaurusx 6y ago
  For a more toxic version of a similar kind of bot, check out SubSimulatorGPT2: https://www.reddit.com/r/SubSimulatorGPT2/top/?sort=top&t=all https://www.reddit.com/r/SubSimulatorGPT2/top/?sort=top&t=al... Unfortunately you can't talk to it. (I've wanted to retrain a version that you can interact with dynamically, someday.)
  - bkanber 6y ago
    The comment thread on the self-awareness post is both very convincing and really meta. I love how clear the training of the different bots is.
Cakez0r 6y ago
Was the bot nonsensical without the fine tuning, or just subjectively a worse conversational partner?

dkdk8283 6y ago

I think the GPU price you’re quoting is about 10k too high. $8500 for the V100/32gb

Jack000 6y ago
> The 9.4B parameter model requires at least two 32gb V100 GPUs to interact with plus motherboard, cpu, ram etc.