5 ms·

Wouldn't it be trivial to add a "read-only" mode to the LLM's operation, where it uses stored knowledge to answer queries but doesn't ingest new knowledge from

Wouldn't it be trivial to add a "read-only" mode to the LLM's operation, where it uses stored knowledge to answer queries but doesn't ingest new knowledge from those queries?

humanistbot 4y ago
From https://help.openai.com/en/articles/7039943-data-usage-for-consumer-services-faq https://help.openai.com/en/articles/7039943-data-usage-for-c...: > You can request to opt out of having your content used to improve our services at any time by filling out this form (https://docs.google.com/forms/d/1t2y-arKhcjlKc1I5ohl9Gb16t6Sq-iaybVFEbLFFjaI/edit?ts=63cec7c0 https://docs.google.com/forms/d/1t2y-arKhcjlKc1I5ohl9Gb16t6S...). This opt out will apply on a going-forward basis only. It goes to a google form, which is I guess better then them building their own survey platform from scratch that may have more vulnerabilities.
- meghan_rain 4y ago
  I'd be worried this is also the "how to get banned from OpenAI in the near future" form. and if OpenAI retains a monopoly like Google does for search, you are basically screwed.
  - visarga 4y ago
    No, everyone will have GPT-4 level AI in 6-12 months.
  - ben_w 4y ago
    I'm old enough to remember when newspapers reported hackers being banned from using computers. And IP pirates banned from using the internet. Actually, that one I remember I voted against my local MP after they passed a law to make that the norm. We don't yet have a social, let alone legal, norm for antisocial use of LLMs; even with social media, government rules are playing catch-up with terms of service, and Facebook is old enough that if it was human it could now vote. So, yes, likewise computers/internet/social media, being banned from an LLM if it's a monopoly is going to seriously harm people. But that is likely to be a big "if". The architecture and the the core training data for GPT-3 isn't a secret, and that's already pretty impressive even if lesser than 3.5 and 4.
- eternalban 4y ago
  > them building their own survey platform from scratch Funny. This nobel prize winner raises an interesting question: If your AI is so great at coding, why is your software so buggy?: https://paulromer.net/openai-bug/ https://paulromer.net/openai-bug/
johntiger1 4y ago
Why isn't it read-only by default? it's not even connected to the internet
- ben_w 4y ago
  ChatGPT, and I think all the GPT LLMs, is only accessible over the internet as far as I can tell. And the thumbs up/down are there on the chat interface because it's partly trained by reinforcement from human feedback.
  - famouswaffles 4y ago
    Nope. LLMs don't use the internet for inference at all unless you give it access to a web search api or something like that. chtGPT is just too massive to run on any local machine. But make no mistake, it does not require the internet.
    - ben_w 4y ago
      I didn't say "for inference", and neither did the person I replied to. GPT uses the internet to connect to users, but rather more importantly chatGPT in particular has a layer on top of GPT which is trained from human feedback. Keywords search "RLHF". That feedback mechanism is, if anything, becoming more detailed as time passes, so I must infer that it's still considered highly important, probably even for the 3.5 model.
      - famouswaffles 4y ago
        The model isn't being trained as time goes on.
        ben_w 4y ago
        The RLHF layer is, and that layer is important. That it does any of this is the specific reason for the story you're commenting on, and why putting data into it isn't like putting the same data into e.g. a Google Docs spreadsheet.

Wouldn't it be trivial to add a "read-only" mode to the LLM's operation, where it uses stored knowledge to answer queries but doesn't ingest new knowledge from those queries?

humanistbot 4y ago

From https://help.openai.com/en/articles/7039943-data-usage-for-consumer-services-faq https://help.openai.com/en/articles/7039943-data-usage-for-c...: > You can request to opt out of having your content used to improve our services at any time by filling out this form (https://docs.google.com/forms/d/1t2y-arKhcjlKc1I5ohl9Gb16t6Sq-iaybVFEbLFFjaI/edit?ts=63cec7c0 https://docs.google.com/forms/d/1t2y-arKhcjlKc1I5ohl9Gb16t6S...). This opt out will apply on a going-forward basis only. It goes to a google form, which is I guess better then them building their own survey platform from scratch that may have more vulnerabilities.

meghan_rain 4y ago
I'd be worried this is also the "how to get banned from OpenAI in the near future" form. and if OpenAI retains a monopoly like Google does for search, you are basically screwed.
- visarga 4y ago
  No, everyone will have GPT-4 level AI in 6-12 months.
- ben_w 4y ago
  I'm old enough to remember when newspapers reported hackers being banned from using computers. And IP pirates banned from using the internet. Actually, that one I remember I voted against my local MP after they passed a law to make that the norm. We don't yet have a social, let alone legal, norm for antisocial use of LLMs; even with social media, government rules are playing catch-up with terms of service, and Facebook is old enough that if it was human it could now vote. So, yes, likewise computers/internet/social media, being banned from an LLM if it's a monopoly is going to seriously harm people. But that is likely to be a big "if". The architecture and the the core training data for GPT-3 isn't a secret, and that's already pretty impressive even if lesser than 3.5 and 4.
eternalban 4y ago
> them building their own survey platform from scratch Funny. This nobel prize winner raises an interesting question: If your AI is so great at coding, why is your software so buggy?: https://paulromer.net/openai-bug/ https://paulromer.net/openai-bug/

johntiger1 4y ago

Why isn't it read-only by default? it's not even connected to the internet

ben_w 4y ago
ChatGPT, and I think all the GPT LLMs, is only accessible over the internet as far as I can tell. And the thumbs up/down are there on the chat interface because it's partly trained by reinforcement from human feedback.
- famouswaffles 4y ago
  Nope. LLMs don't use the internet for inference at all unless you give it access to a web search api or something like that. chtGPT is just too massive to run on any local machine. But make no mistake, it does not require the internet.
  - ben_w 4y ago
    I didn't say "for inference", and neither did the person I replied to. GPT uses the internet to connect to users, but rather more importantly chatGPT in particular has a layer on top of GPT which is trained from human feedback. Keywords search "RLHF". That feedback mechanism is, if anything, becoming more detailed as time passes, so I must infer that it's still considered highly important, probably even for the 3.5 model.
    - famouswaffles 4y ago
      The model isn't being trained as time goes on.
      - ben_w 4y ago
        The RLHF layer is, and that layer is important. That it does any of this is the specific reason for the story you're commenting on, and why putting data into it isn't like putting the same data into e.g. a Google Docs spreadsheet.