5 ms·

It's several reasons, first it's the lies and the abuse of a charity, that wouldn't be an issue if they had began as a private company instead of robbing a char

It's several reasons, first it's the lies and the abuse of a charity, that wouldn't be an issue if they had began as a private company instead of robbing a charity. But secondly, even if they were a private company, it's dishonest and reprehensible to claim to congress that you want to "protect the public" when you really only give a shit about protecting your moat, I'm not happy about that either. I'm also tired of tech oligarchs general tomfuckery in all our daily lives, as I suspect many more people here are. OpenAI is just particularly egregious about it. I also think it's my civic duty to let other developers know that OpenAI does not have, by any stretch of the imagination, a stranglehold on this technology or any secret sauce. That's why they're lying and sweating in front of congress.

victor9000 3y ago
Yeah, they went from v1 to regulatory capture in the span of months
- echelon 3y ago
  > regulatory capture If this leak is correct, regulatory capture is likely the only moat OpenAI could have hoped for. It would explain why Sam was so absolutely adamant that this tech needed to receive oversight. If correct, every big tech company now has a recipe to build their own GPT-4. I'd expect for the open source efforts to try to duplicate the results as well. LLMs will increase in quality across the board and become fairly interchangeable, leading to thin margins and a race to the bottom. We could be watching $13 billion going up in flames, all of it predicated on a secret as flimsy as the Coca-Cola recipe.
  - fnordpiglet 3y ago
    Just wait until the RLHF class action hits them.
  - cma 3y ago
    $13 billion isn't $13 billion if $N billion of it has to mandatorily be spent on high margin (70%?) Azure services.
  - K0balt 3y ago
    Tbf the coca-cola recipe is a more sustainable trade secret, since the product is “perfected”. GPT4 is a work in progress so a competitor can be objectively better. I’m hoping for open source models to start incorporating some of these ideas.
  - deleted 3y ago
    [deleted]
BoorishBears 3y ago
Did you actually read my comment or did you have a preplanned diatribe? They didn't start the private company until the person who promised them $1B reneged. That person reneged because they tried to forcefully takeover and were rebuked. They were running out of money and forced to raise funds in a very for-profit way or fold. - Edit: Rate limited because the hivemind has decided that it's unacceptable to insult their leader People keep acting like if it wasn't for OpenAI we'd be in some LLM utopia. The reality is some other big tech giant would reach the current SOTA first and we'd be in the same predicament except with a company with 1000x more machinery to do the things you're complaining about. It's ridiculous the sense of entitlement some people must have to keep insisting that OpenAI should have crawled into a cave and died because some megalomaniac threw a tantrum.
- PostOnce 3y ago
  So fold. Running out of money to run a charity means they now suddenly need to fuck over the people the charity was supposed to help (that is, everyone on earth) ? Imagine if a feed the homeless charity accepted private investment and went around installing anti-homeless spikes everywhere after stopping feeding anyone. It's a similar style of behavior.
  - ben_w 3y ago
    It's not even remotely the same as anti-homeless spikes. We've just had the massive fine against 3M for knowing and hiding the risks of PFAS, and the top comments here were "increase the fines! Lock up the bosses!" Now we have a company going "we had to put a lot of effort into preventing this model from cheerfully outputting Al Quaida propaganda, explicit rape threats, and detailed instructions for an amateur to make deadly chemicals using only home supplies", and despite that effort they still had legal trouble in Italy because the output was unsuitable for minors (as well as the GDPR issues that were the primary headline at the time). And a lot of researchers with no financial incentives saying "yup, there's danger in these AI". The reaction here? Disbelief OpenAI might be saying what they mean, and meaning what they say. And people parroting "moat!" as if none of the other FAANGs could trivially cross any regulatory barriers that emerge. It's like the entire topic of AI has been politicised harder than "is nuclear power green?"
downWidOutaFite 3y ago
The "regulatory capture" conspiracy theory makes no sense to me. It takes 9 figures in cash to create and run one of these super big models. Only big tech was ever going to create them, and big tech is already very experienced at navigating regulation, regulation wasn't ever going to stop them from competing. And in general, our democracy works better than the nihilist libertarians give it credit for.
- flir 3y ago
  I bet it'll be 6 figures within 18 months.
  - ben_w 3y ago
    Even if it was free to train, FAANGs can beat OpenAI on spending to follow regulations.
  - RC_ITR 3y ago
    The thing about these models is compute scales quadratically with model dimensionality and memory scales quadratically with sequence length. We are nowhere near diminishing returns for either variable, so sure current models maybe scale quickly but the cutting edge will want as much compute as possible for a long time. That’s kind of the humor of everyone saying this leak somehow leaves OpenAI vulnerable. The work isn’t deciding if an MoE is the right architecture or not, it’s how to run 25k GPUs concurrently in a fault tolerant way (likely the true reason for the deep Azure links).
    - why_only_15 3y ago
      Memory does not scale quadratically with sequence length.
      - RC_ITR 3y ago
        During training, you have to store a dot product of Q and V that has dimension Ncrt^2. That's quadratic scaling, no?
EagnaIonat 3y ago
> the abuse of a charity, A non-profit and charity are two different things. While a charity is a form of non-profit, it has to follow certain rules to qualify as one. Their profits must go towards the charity. A non-profit is a company that is set up not to make a profit. It is allowed to make a profit if it does. This is what OpenAI was. They switched to a "capped" for-profit model so that they could get more funding. It also allowed their employees to invest in the company, and openAI gave equity to their employees. There was no lies or abuse. Where did you get that information from?
- feoren 3y ago
  > It is allowed to make a profit if it does. A nonprofit is subject to the non-distribution constraint: any revenues that exceed expenses must be committed to the organization's purpose, not taken by private parties. https://en.wikipedia.org/wiki/Nonprofit_organization https://en.wikipedia.org/wiki/Nonprofit_organization

victor9000 3y ago

Yeah, they went from v1 to regulatory capture in the span of months

echelon 3y ago
> regulatory capture If this leak is correct, regulatory capture is likely the only moat OpenAI could have hoped for. It would explain why Sam was so absolutely adamant that this tech needed to receive oversight. If correct, every big tech company now has a recipe to build their own GPT-4. I'd expect for the open source efforts to try to duplicate the results as well. LLMs will increase in quality across the board and become fairly interchangeable, leading to thin margins and a race to the bottom. We could be watching $13 billion going up in flames, all of it predicated on a secret as flimsy as the Coca-Cola recipe.
- fnordpiglet 3y ago
  Just wait until the RLHF class action hits them.
- cma 3y ago
  $13 billion isn't $13 billion if $N billion of it has to mandatorily be spent on high margin (70%?) Azure services.
- K0balt 3y ago
  Tbf the coca-cola recipe is a more sustainable trade secret, since the product is “perfected”. GPT4 is a work in progress so a competitor can be objectively better. I’m hoping for open source models to start incorporating some of these ideas.
- deleted 3y ago
  [deleted]

BoorishBears 3y ago

Did you actually read my comment or did you have a preplanned diatribe? They didn't start the private company until the person who promised them $1B reneged. That person reneged because they tried to forcefully takeover and were rebuked. They were running out of money and forced to raise funds in a very for-profit way or fold. - Edit: Rate limited because the hivemind has decided that it's unacceptable to insult their leader People keep acting like if it wasn't for OpenAI we'd be in some LLM utopia. The reality is some other big tech giant would reach the current SOTA first and we'd be in the same predicament except with a company with 1000x more machinery to do the things you're complaining about. It's ridiculous the sense of entitlement some people must have to keep insisting that OpenAI should have crawled into a cave and died because some megalomaniac threw a tantrum.

PostOnce 3y ago
So fold. Running out of money to run a charity means they now suddenly need to fuck over the people the charity was supposed to help (that is, everyone on earth) ? Imagine if a feed the homeless charity accepted private investment and went around installing anti-homeless spikes everywhere after stopping feeding anyone. It's a similar style of behavior.
- ben_w 3y ago
  It's not even remotely the same as anti-homeless spikes. We've just had the massive fine against 3M for knowing and hiding the risks of PFAS, and the top comments here were "increase the fines! Lock up the bosses!" Now we have a company going "we had to put a lot of effort into preventing this model from cheerfully outputting Al Quaida propaganda, explicit rape threats, and detailed instructions for an amateur to make deadly chemicals using only home supplies", and despite that effort they still had legal trouble in Italy because the output was unsuitable for minors (as well as the GDPR issues that were the primary headline at the time). And a lot of researchers with no financial incentives saying "yup, there's danger in these AI". The reaction here? Disbelief OpenAI might be saying what they mean, and meaning what they say. And people parroting "moat!" as if none of the other FAANGs could trivially cross any regulatory barriers that emerge. It's like the entire topic of AI has been politicised harder than "is nuclear power green?"

downWidOutaFite 3y ago

The "regulatory capture" conspiracy theory makes no sense to me. It takes 9 figures in cash to create and run one of these super big models. Only big tech was ever going to create them, and big tech is already very experienced at navigating regulation, regulation wasn't ever going to stop them from competing. And in general, our democracy works better than the nihilist libertarians give it credit for.

flir 3y ago
I bet it'll be 6 figures within 18 months.
- ben_w 3y ago
  Even if it was free to train, FAANGs can beat OpenAI on spending to follow regulations.
- RC_ITR 3y ago
  The thing about these models is compute scales quadratically with model dimensionality and memory scales quadratically with sequence length. We are nowhere near diminishing returns for either variable, so sure current models maybe scale quickly but the cutting edge will want as much compute as possible for a long time. That’s kind of the humor of everyone saying this leak somehow leaves OpenAI vulnerable. The work isn’t deciding if an MoE is the right architecture or not, it’s how to run 25k GPUs concurrently in a fault tolerant way (likely the true reason for the deep Azure links).
  - why_only_15 3y ago
    Memory does not scale quadratically with sequence length.
    - RC_ITR 3y ago
      During training, you have to store a dot product of Q and V that has dimension Ncrt^2. That's quadratic scaling, no?

EagnaIonat 3y ago

> the abuse of a charity, A non-profit and charity are two different things. While a charity is a form of non-profit, it has to follow certain rules to qualify as one. Their profits must go towards the charity. A non-profit is a company that is set up not to make a profit. It is allowed to make a profit if it does. This is what OpenAI was. They switched to a "capped" for-profit model so that they could get more funding. It also allowed their employees to invest in the company, and openAI gave equity to their employees. There was no lies or abuse. Where did you get that information from?

feoren 3y ago
> It is allowed to make a profit if it does. A nonprofit is subject to the non-distribution constraint: any revenues that exceed expenses must be committed to the organization's purpose, not taken by private parties. https://en.wikipedia.org/wiki/Nonprofit_organization https://en.wikipedia.org/wiki/Nonprofit_organization