4 ms·

True, though to be fair, when OpenAI embraced "openness" it was also a PR stunt.

by kibwen 3y ago

ta8645 3y ago
My impression is that OpenAI was founded by true believers, with the best intentions; whose hopes were ultimately sidelined in the inexorable crush of business and finance.
- deleted 3y ago
  [deleted]
- jprete 3y ago
  Sam Altman is one of the founders, so for your impression to be right he'd have to be sidelining his own hopes.
- deleted 3y ago
  [deleted]
- dkjaudyeqooe 3y ago
  > OpenAI was founded by true believers, with the best intentions who were easily bought off.
ben_w 3y ago
OpenAI is heavily influenced by big-R Rationalists, who fear the issues of misaligned AI being given power to do bad things. When they were first talking about this, lots of people ignored this by saying "let's just keep the AI in a box", and even last year it was "what's so hard about an off switch?". The problem with any model you can just download and run is that some complete idiot will do that and just give the AI agency they shouldn't have. Fortunately, for now the models are more of a threat to their users than anyone else — lawyers who use it to do lawyering without checking the results losing their law licence, etc. But that doesn't mean open models are not a threat to other people besides their users, as all the artists complaining about losing work due to Stable Diffusion, the law enforcement people concerned about illegal porn, election interference specialists worried about propaganda, and anyone trying to use a search engine, and that research lab that found a huge number of novel nerve agent candidates whose precursors aren't all listed as dual use, will all tell you for different reasons.
- visarga 3y ago
  > Fortunately, for now the models are more of a threat to their users than anyone else Models have access to users, users have access to dangerous stuff. Seems like we are already vulnerable. The AI splits a task in two parts, and gets two people to execute each part without knowing the effect. This was a scenario in one of Asimov's robot novels, but the roles were reversed. AI models exposed to public at large is a huge security hole. We got to live with the consequences, no turning back now.

True, though to be fair, when OpenAI embraced "openness" it was also a PR stunt.

by kibwen 3y ago

True, though to be fair, when OpenAI embraced "openness" it was also a PR stunt.

My impression is that OpenAI was founded by true believers, with the best intentions; whose hopes were ultimately sidelined in the inexorable crush of business and finance.

deleted 3y ago
[deleted]
jprete 3y ago
Sam Altman is one of the founders, so for your impression to be right he'd have to be sidelining his own hopes.
deleted 3y ago
[deleted]
dkjaudyeqooe 3y ago
> OpenAI was founded by true believers, with the best intentions who were easily bought off.

ben_w 3y ago

OpenAI is heavily influenced by big-R Rationalists, who fear the issues of misaligned AI being given power to do bad things. When they were first talking about this, lots of people ignored this by saying "let's just keep the AI in a box", and even last year it was "what's so hard about an off switch?". The problem with any model you can just download and run is that some complete idiot will do that and just give the AI agency they shouldn't have. Fortunately, for now the models are more of a threat to their users than anyone else — lawyers who use it to do lawyering without checking the results losing their law licence, etc. But that doesn't mean open models are not a threat to other people besides their users, as all the artists complaining about losing work due to Stable Diffusion, the law enforcement people concerned about illegal porn, election interference specialists worried about propaganda, and anyone trying to use a search engine, and that research lab that found a huge number of novel nerve agent candidates whose precursors aren't all listed as dual use, will all tell you for different reasons.

visarga 3y ago
> Fortunately, for now the models are more of a threat to their users than anyone else Models have access to users, users have access to dangerous stuff. Seems like we are already vulnerable. The AI splits a task in two parts, and gets two people to execute each part without knowing the effect. This was a scenario in one of Asimov's robot novels, but the roles were reversed. AI models exposed to public at large is a huge security hole. We got to live with the consequences, no turning back now.