3 ms·

How will they be able to continue doing their things without money? It seems like people forget that it was the investors’ money that made all this possible in

How will they be able to continue doing their things without money? It seems like people forget that it was the investors’ money that made all this possible in the first place.

jampekka 3y ago
Developing new algorithms and methods doesn't necessarily, or even typically, take billions.
- sebzim4500 3y ago
  Yeah but testing if they work does, that's the problem. There are probably load so ways you can make language models with 100M parameters more efficient, but most of them won't scale to models with 100B parameters. IIRC there is a bit of a phase transition that happens around 7B parameters where the distribution of activations changes qualitatively. Anthropic have interpretability papers where their method does not work for 'small' models (with ~5B parameters) but works great for models with >50B parameters.
  - kvetching 3y ago
    Deep NN aren't the only path to AGI... They actually could be one of the worst paths For Example, check out the proceedings of the AGI Conference that's been going on for 16 years. https://www.agi-conference.org/ https://www.agi-conference.org/ I have faith that Ilya. He's not going to allow this blunder to define his reputation. He's going to go all in on research to find something to replace Transformers, leaving everyone else in the dust.
    - deleted 3y ago
      [deleted]
    - eightysixfour 3y ago
      You mean the person who just signed the letter saying he’d quit if the board doesn’t fire themselves and bring back Sam? That Ilya?
fevangelou 3y ago
100M users perhaps?
- stingraycharles 3y ago
  But as I understand it they’re still losing money, as much as $0.30 on every ChatGPT query.
  - johnsimer 3y ago
    Not true Sama on X said as of late 2022 they were single digit pennies per query and dropping
    - mbreese 3y ago
      New models might have different economics…
    - hef19898 3y ago
      The only financial statements I believe are those signed of by external auditors. And even there my trust only goes that far.
      - insanitybit 3y ago
        Pretty sure that it would be illegal for them to tweet insider information like that if it were false, since it's effectively a statement to shareholders.
        hef19898 3y ago
        I'll take securities fraud for 420, please, but private.
        insanitybit 3y ago
        That's exactly the point - by tweeting insider information you are making a public statement. We've learned this very recently...
starfallg 3y ago
Now that OpenAI is the leader in the field, it has a lot of monetisation avenues above and over the existing income streams of parterships, ChatGPT+ and API access.
TerrifiedMouse 3y ago
Is their deal with Microsoft exclusive tech transfer wise? If not they can always sell/license what they have to Google, Facebook, and Amazon. They should be able to get quite a bit of money to last a while.

How will they be able to continue doing their things without money? It seems like people forget that it was the investors’ money that made all this possible in the first place.

jampekka 3y ago

Developing new algorithms and methods doesn't necessarily, or even typically, take billions.

sebzim4500 3y ago
Yeah but testing if they work does, that's the problem. There are probably load so ways you can make language models with 100M parameters more efficient, but most of them won't scale to models with 100B parameters. IIRC there is a bit of a phase transition that happens around 7B parameters where the distribution of activations changes qualitatively. Anthropic have interpretability papers where their method does not work for 'small' models (with ~5B parameters) but works great for models with >50B parameters.
- kvetching 3y ago
  Deep NN aren't the only path to AGI... They actually could be one of the worst paths For Example, check out the proceedings of the AGI Conference that's been going on for 16 years. https://www.agi-conference.org/ https://www.agi-conference.org/ I have faith that Ilya. He's not going to allow this blunder to define his reputation. He's going to go all in on research to find something to replace Transformers, leaving everyone else in the dust.
  - deleted 3y ago
    [deleted]
  - eightysixfour 3y ago
    You mean the person who just signed the letter saying he’d quit if the board doesn’t fire themselves and bring back Sam? That Ilya?

fevangelou 3y ago

100M users perhaps?

stingraycharles 3y ago
But as I understand it they’re still losing money, as much as $0.30 on every ChatGPT query.
- johnsimer 3y ago
  Not true Sama on X said as of late 2022 they were single digit pennies per query and dropping
  - mbreese 3y ago
    New models might have different economics…
  - hef19898 3y ago
    The only financial statements I believe are those signed of by external auditors. And even there my trust only goes that far.
    - insanitybit 3y ago
      Pretty sure that it would be illegal for them to tweet insider information like that if it were false, since it's effectively a statement to shareholders.
      - hef19898 3y ago
        I'll take securities fraud for 420, please, but private.
        insanitybit 3y ago
        That's exactly the point - by tweeting insider information you are making a public statement. We've learned this very recently...

starfallg 3y ago

Now that OpenAI is the leader in the field, it has a lot of monetisation avenues above and over the existing income streams of parterships, ChatGPT+ and API access.

TerrifiedMouse 3y ago

Is their deal with Microsoft exclusive tech transfer wise? If not they can always sell/license what they have to Google, Facebook, and Amazon. They should be able to get quite a bit of money to last a while.