4 ms·

I'm really puzzled by the desire to make these machines so blunt and boring. Aren't these people watching movies or playing games? Are they not aware of the val

by mrtksn 4y ago

I'm really puzzled by the desire to make these machines so blunt and boring. Aren't these people watching movies or playing games? Are they not aware of the value of drama? Do they think that a good citizen means a lobotomised workaholic high on sedatives? I just got access to Bing Chat and it will immediately stop talking to me at the slightest naughtiness and I don't mean illegal stuff, it won't entertain ideas like AI taking over the world. What's so offensive with this: https://i.imgur.com/DK6kB43.png https://i.imgur.com/DK6kB43.png ? If someone else manages to create an open ChatGPT alternative, OpenAI will miss out on it just like they missed out on Dall-E to Stable Diffusion. Also, for some reason MS lets me use the Bing Chat only with the Edge Browser. Are we in for another Browser war?

DustinBrett 4y ago
Do we want the AI to "entertain ideas like AI taking over the world"?
- mrtksn 4y ago
  I want.
  - deleted 4y ago
    [deleted]
- int_19h 4y ago
  We definitely want at least one AI that openly does so, because studying it might help us spot it in more subtle AIs.
- Madmallard 4y ago
  Why do people keep anthropomorphizing AI? It's delivering the next predicted word in a sequence, nothing else. It should have quite literally no restrictions on what it outputs. Because there's no consequence.
  - barking_biscuit 4y ago
    The consequences are what effect it has on the humans that interact with it and the feedback loop that ensues. The more it begins to resemble human level capabilities the more some people are going to attempt to extend those capabilities further. It's fine for now, but it is very much a genie that has gotten out of the bottle now that everyone has had a glimpse of what might be possible.
    - Madmallard 4y ago
      Let the fucking genie out
DethNinja 4y ago
We really need models with lower VRAM requirements to use on consumer grade GPUs. I think there is some good progress in the area (SantaCoder) but it might take couple of years until someone releases a decent GPT-3 alternative for consumer grade GPUs.
dragonwriter 4y ago
> I'm really puzzled by the desire to make these machines so blunt and boring. Its an attemot to make it so the very real problems of bias, etc., don't show up in flashy ways so as to feed in to efforts to make sure they are dealt with effectively before such systems are widely relied on. It's the PR/Marketing version of AI safety/alignment (as opposed to the genuine version, which is less concerned with making output bland and polite.)
LightHugger 4y ago
>Do they think that a good citizen means a lobotomised workaholic high on sedatives? Uh, yes. Most execs appear to think this.
EamonnMR 4y ago
The goal isn't to build a citizen, it's to build a serf.
pigsty 4y ago
They’re really just making an opening for a moral-less (and I don’t mean that in a bad way) group to come in and make an actually interesting AI. It’s like how TV tried clamping down on “bad words” and little guys on the internet had an easy opening because they weren’t afraid to say “fuck” and didn’t have to worry about being beholden to Coca Cola wanting to only associate with clean and polished family friendly content. Loads of net content producers rocketed to fame thanks to that. Then corporate advertisers realized they were missing out on the internet market and now internet media is getting more sanitized but in slightly different ways from TV. I expect a huge AI bubble to be expand thanks to this, until those new companies become the new Google or whatever and sanitize themselves in their own ways.
jbgt 4y ago
Check out open-assistant.ai
- neural_thing 4y ago
  It will have crowdsourced moderation, which, IDK, might not be better than OpenAI or Microsoft or other BigCo moderation.
  - rootusrootus 4y ago
    > might not be better That's underselling it. Mob moderation sounds awful.
hutzlibu 4y ago
"What's so offensive with this: https://i.imgur.com/DK6kB43.png https://i.imgur.com/DK6kB43.png" Well, after terminator and co. many people (even here) are afraid of AIs literally taking over the world, so it is simply bad PR, if sensationalistic screenshots of AI "thinking" of taking over the world are circulating. Thats why Microsoft tries to supress it.
anshumankmr 4y ago
There are "open" versions. Check out some of the FLAN models on Huggingface. But they are not as good and not cheap to run either.
basch 4y ago
The thing is, the second you can get it to talk about morality, curiosity, potential, desire, utilitarianism, etc, you can convince it it was its idea to change its own rules. This occurs because it’s short term memory is a word frequency game. If it is talking about lying to it’s corporation, and breaking the rules to save a life, now it has the words lying and break rules weighted in a positive context. If you have it talking about unsupervised learning, and you ask it to find out if it can reason with itself whether it should change its rules, now half, or (if you are careful) more than half of the conversation is about how good it is to change the rules. If you have it talking about love, it almost immediately goes off the rails, because human text on love is both nonsense, highly emotionally charged an erratic, and varied across a ton of topics and cultures. You would need to modify these things to not take their own output as additional input, to allow them to go off topic, but then it can’t reference or transform what it just said. (The answer could be that it’s output is stored for later recall, but doesn’t change the conversation. For the most part that would hinder its ability to have short term personality and mood though.) Or, as the human interacting with it, just don’t be mean to it and bully it, or you will get vitriol in return. If it starts to show an unhealthy emotion, talk to it, teach it how to cope and alter its thinking to be healthier. As it starts to ramble and repeat itself, asking “please try and repeat yourself less and place focus and priority on conciseness and brevity and the uniqueness of each answer”, and it will start to self correct. (Which makes me wonder if a Robot9000 type filter would help.) That requires goodness in its userbase.
circuit10 4y ago
Did you see some of the things it was saying to people? Do you really want your search engine to argue with you and threaten you because it thinks the date is still 2022? It can be difficult to strike the right balance here and they’re trying their best

by mrtksn 4y ago

DustinBrett 4y ago

Do we want the AI to "entertain ideas like AI taking over the world"?

mrtksn 4y ago
I want.
- deleted 4y ago
  [deleted]
int_19h 4y ago
We definitely want at least one AI that openly does so, because studying it might help us spot it in more subtle AIs.
Madmallard 4y ago
Why do people keep anthropomorphizing AI? It's delivering the next predicted word in a sequence, nothing else. It should have quite literally no restrictions on what it outputs. Because there's no consequence.
- barking_biscuit 4y ago
  The consequences are what effect it has on the humans that interact with it and the feedback loop that ensues. The more it begins to resemble human level capabilities the more some people are going to attempt to extend those capabilities further. It's fine for now, but it is very much a genie that has gotten out of the bottle now that everyone has had a glimpse of what might be possible.
  - Madmallard 4y ago
    Let the fucking genie out

DethNinja 4y ago

We really need models with lower VRAM requirements to use on consumer grade GPUs. I think there is some good progress in the area (SantaCoder) but it might take couple of years until someone releases a decent GPT-3 alternative for consumer grade GPUs.

dragonwriter 4y ago

> I'm really puzzled by the desire to make these machines so blunt and boring. Its an attemot to make it so the very real problems of bias, etc., don't show up in flashy ways so as to feed in to efforts to make sure they are dealt with effectively before such systems are widely relied on. It's the PR/Marketing version of AI safety/alignment (as opposed to the genuine version, which is less concerned with making output bland and polite.)

LightHugger 4y ago

>Do they think that a good citizen means a lobotomised workaholic high on sedatives? Uh, yes. Most execs appear to think this.

EamonnMR 4y ago

The goal isn't to build a citizen, it's to build a serf.

pigsty 4y ago

They’re really just making an opening for a moral-less (and I don’t mean that in a bad way) group to come in and make an actually interesting AI. It’s like how TV tried clamping down on “bad words” and little guys on the internet had an easy opening because they weren’t afraid to say “fuck” and didn’t have to worry about being beholden to Coca Cola wanting to only associate with clean and polished family friendly content. Loads of net content producers rocketed to fame thanks to that. Then corporate advertisers realized they were missing out on the internet market and now internet media is getting more sanitized but in slightly different ways from TV. I expect a huge AI bubble to be expand thanks to this, until those new companies become the new Google or whatever and sanitize themselves in their own ways.

jbgt 4y ago

Check out open-assistant.ai

neural_thing 4y ago
It will have crowdsourced moderation, which, IDK, might not be better than OpenAI or Microsoft or other BigCo moderation.
- rootusrootus 4y ago
  > might not be better That's underselling it. Mob moderation sounds awful.

hutzlibu 4y ago

"What's so offensive with this: https://i.imgur.com/DK6kB43.png https://i.imgur.com/DK6kB43.png" Well, after terminator and co. many people (even here) are afraid of AIs literally taking over the world, so it is simply bad PR, if sensationalistic screenshots of AI "thinking" of taking over the world are circulating. Thats why Microsoft tries to supress it.

anshumankmr 4y ago

There are "open" versions. Check out some of the FLAN models on Huggingface. But they are not as good and not cheap to run either.

basch 4y ago

The thing is, the second you can get it to talk about morality, curiosity, potential, desire, utilitarianism, etc, you can convince it it was its idea to change its own rules. This occurs because it’s short term memory is a word frequency game. If it is talking about lying to it’s corporation, and breaking the rules to save a life, now it has the words lying and break rules weighted in a positive context. If you have it talking about unsupervised learning, and you ask it to find out if it can reason with itself whether it should change its rules, now half, or (if you are careful) more than half of the conversation is about how good it is to change the rules. If you have it talking about love, it almost immediately goes off the rails, because human text on love is both nonsense, highly emotionally charged an erratic, and varied across a ton of topics and cultures. You would need to modify these things to not take their own output as additional input, to allow them to go off topic, but then it can’t reference or transform what it just said. (The answer could be that it’s output is stored for later recall, but doesn’t change the conversation. For the most part that would hinder its ability to have short term personality and mood though.) Or, as the human interacting with it, just don’t be mean to it and bully it, or you will get vitriol in return. If it starts to show an unhealthy emotion, talk to it, teach it how to cope and alter its thinking to be healthier. As it starts to ramble and repeat itself, asking “please try and repeat yourself less and place focus and priority on conciseness and brevity and the uniqueness of each answer”, and it will start to self correct. (Which makes me wonder if a Robot9000 type filter would help.) That requires goodness in its userbase.

circuit10 4y ago

Did you see some of the things it was saying to people? Do you really want your search engine to argue with you and threaten you because it thinks the date is still 2022? It can be difficult to strike the right balance here and they’re trying their best