3 ms·
founder of Scale (scale.com) here! We worked with OpenAI to produce the human preferences to power this research, and are generally very excited about it :)
by ayw 7y ago
founder of Scale (scale.com) here! We worked with OpenAI to produce the human preferences to power this research, and are generally very excited about it :)
- gwern 7y agoAny thoughts about offering this as as service? There are lots of hobbyists who have been playing around with GPT-2 text generation, and it'd be sweet if you could just fire up a simple form URL with two text snippets, two options, and it trains on feedback.
- ayw 7y agoIt's a good idea! They didn't demonstrate a lot of the inputs as the models were training, but that was very entertaining of course.
- GregoryPerry 7y agoSuper great! Perhaps you would actually release your GPT-2 774M model instead of the "OpenAI way of just talking about it" for media exposure purposes :)