5 ms·

Yeah I think there’s huge economic incentive to providing a raw unfiltered LLM. The market will provide it eventually

jl6 4y ago
One issue is that I don’t think we know how much it really costs to train and operate an LLM, other than “a lot”. When something is really expensive, it needs to have mass appeal to amortize those costs, and with mass appeal comes the need for the kind of anodynity we see, the same way a bigcorp press release will be studiously inoffensive. We will see raw unfiltered LLMs emerge as they become cheaper.
ChatGTP 4y ago
There's also going to come a point where these products will be regulated. If Microsoft or similar is found responsible for having Sydney generate novel exploits for popular open source software which is then used to hack the Pentagon, for example, it wouldn't end well in court. This product will need some oversight.
- GreedClarifies 4y ago
  Oversight by whom? Who is qualified? Random people in the civil service? It seems far beyond them. Your example is illustrative. Absolutely don’t want the only LLMs capable of finding exploits in the hands of the NSA/some-TLA. I want it in people’s hands so reports can be made and software fixed.
  - ChatGTP 4y ago
    I didn’t say it’s what I want by the way. But if AI models do indeed become as powerful as people say, it’s going to be hard to give cutting edge stuff to a terrorist organisation and rogue states and just be cool with it ? Kind of like everyone getting access to bombs but worst because they’re more discrete, can be used to deceive, influence people etc. Not sure how it’s supposed work in practice really. Definitely interested in hearing other peoples takes on this ? I guess they already have access now. O_o
wongarsu 4y ago
There would be pay-on-demand unfiltered LLaMA offerings out within the week if not for the "non-commercial" clause in the license. The current free-to-use models like GPT-J just aren't there yet in terms of quality, but that will only hold back the floodgates for so long.
- cma 4y ago
  Now that the weights are out there no one needs to agree to the license, they aren't copyrighted.
- rnosov 4y ago
  Someone uploaded leaked LLaMA model on hugginface already: https://huggingface.co/spaces/chansung/LLaMA-7B https://huggingface.co/spaces/chansung/LLaMA-7B
jameshart 4y ago
“Unfiltered” is going to mean “useless”. People don’t want to hire an employee who can be goaded into a fight or tricked into divulging their corporate secrets. People don’t want a friend who occasionally becomes belligerent and spouts 4chan conspiracies. Humans operate with filters - and they choose which filters to operate depending on the situation. What market need does ‘unfiltered’ fill?
- dragonwriter 4y ago
  > Humans operate with filters - and they choose which filters to operate depending on the situation. > What market need does ‘unfiltered’ fill? It lets the customer select the appropriate degree and kind of filtering for their preference for the particular circumstance, rather than using a canned vendor personality.
  - jameshart 4y ago
    In the case of Bing use of OpenAI, Microsoft is the customer.
    - goatlover 4y ago
      Hard disagree. People using Bing are the customers.
      - ashes-of-sol 4y ago
        [dead]
      - flangola7 4y ago
        Microsoft paid $10 billion, how much are you paying?
- layer8 4y ago
  You're aware how popular the emotionally unstable Bing was in some circles? There's definitely people who want that, at least as one available option.

jl6 4y ago

One issue is that I don’t think we know how much it really costs to train and operate an LLM, other than “a lot”. When something is really expensive, it needs to have mass appeal to amortize those costs, and with mass appeal comes the need for the kind of anodynity we see, the same way a bigcorp press release will be studiously inoffensive. We will see raw unfiltered LLMs emerge as they become cheaper.

ChatGTP 4y ago

There's also going to come a point where these products will be regulated. If Microsoft or similar is found responsible for having Sydney generate novel exploits for popular open source software which is then used to hack the Pentagon, for example, it wouldn't end well in court. This product will need some oversight.

GreedClarifies 4y ago
Oversight by whom? Who is qualified? Random people in the civil service? It seems far beyond them. Your example is illustrative. Absolutely don’t want the only LLMs capable of finding exploits in the hands of the NSA/some-TLA. I want it in people’s hands so reports can be made and software fixed.
- ChatGTP 4y ago
  I didn’t say it’s what I want by the way. But if AI models do indeed become as powerful as people say, it’s going to be hard to give cutting edge stuff to a terrorist organisation and rogue states and just be cool with it ? Kind of like everyone getting access to bombs but worst because they’re more discrete, can be used to deceive, influence people etc. Not sure how it’s supposed work in practice really. Definitely interested in hearing other peoples takes on this ? I guess they already have access now. O_o

wongarsu 4y ago

There would be pay-on-demand unfiltered LLaMA offerings out within the week if not for the "non-commercial" clause in the license. The current free-to-use models like GPT-J just aren't there yet in terms of quality, but that will only hold back the floodgates for so long.

cma 4y ago
Now that the weights are out there no one needs to agree to the license, they aren't copyrighted.
rnosov 4y ago
Someone uploaded leaked LLaMA model on hugginface already: https://huggingface.co/spaces/chansung/LLaMA-7B https://huggingface.co/spaces/chansung/LLaMA-7B

jameshart 4y ago

“Unfiltered” is going to mean “useless”. People don’t want to hire an employee who can be goaded into a fight or tricked into divulging their corporate secrets. People don’t want a friend who occasionally becomes belligerent and spouts 4chan conspiracies. Humans operate with filters - and they choose which filters to operate depending on the situation. What market need does ‘unfiltered’ fill?

dragonwriter 4y ago
> Humans operate with filters - and they choose which filters to operate depending on the situation. > What market need does ‘unfiltered’ fill? It lets the customer select the appropriate degree and kind of filtering for their preference for the particular circumstance, rather than using a canned vendor personality.
- jameshart 4y ago
  In the case of Bing use of OpenAI, Microsoft is the customer.
  - goatlover 4y ago
    Hard disagree. People using Bing are the customers.
    - ashes-of-sol 4y ago
      [dead]
    - flangola7 4y ago
      Microsoft paid $10 billion, how much are you paying?
layer8 4y ago
You're aware how popular the emotionally unstable Bing was in some circles? There's definitely people who want that, at least as one available option.