3 ms·

Improving the factual accuracy of language models through web browsing

• TaylorAlexander 5y ago
  I like the note that there is a new risk since their model can access the web at training time. A model in this situation could potentially do something malicious online!
  • gwern 5y ago
    "Don't worry, we'll just make sure it can only do GET commands, which are, per the HTTP spec, side-effect free and idempotent." [later] "Oh no." --- Ha-ha-only-serious joking aside, this is impressive. Early on in the API release, someone showed you could sort of make GPT-3 operate on text representations to put inside a web loop, but it made a lot of errors. This goes well beyond 'sort of'. It may not seem like 'predict the next word' gets you far, but turns out, it's a good starting point. ("Tool AIs want to be agent AIs.")
  • skybrian 5y ago
    I was wondering whether it obeys robots.txt? I guess since it's using Bing, it obeys as well as Bing does?
  • banach 5y ago
    And then CoPilot has been let loose injecting underhanded backdoor code in the guise of utility functions.
• vimax 5y ago
  The next version of copilot will literally be a bot that searches Google and reads through stack overflow posts. There are a lot of jokes you can make, but that is honestly what I do half the day and I've met some people who could barely do that. First they came for the junior dev, but I was not concerned for I was not a junior dev.