19 ms·

OpenAI getting rich now everyone wants a piece and everyone fighting over it like a billion dollar inheretence fight. In a round about way, if GPT5 is nearly a

• oldstrangers 4y ago
  Undoubtedly OpenAI already has some very close ties and/or contracts with the DoD.
  • jstx1 4y ago
    Any evidence for this, or are you just assuming that it's the case?
    • roflyear 4y ago
      To me it overstates what is achieved. This isn't AGI. Unsure how much the government would care about this.
    • polycaster 4y ago
      Don’t now about the DoD, but one of the board members of the nonprofit is Will Hurd, who appears to have had a 9 year career in the CIA before turning to politics. No hard evidence of anything of course, but enough to raise an eyebrow imho.
      • reducesuffering 4y ago
        Will Hurd is/was a managing director at Allen & Company, who runs the Sun Valley conference where this article talked about Satya Nadella and Sam Altman "bumping into each other" to secure the deal. It's looking more and more like OpenAI is the Manhattan project as AGI is to nuclear weapons.
• unshavedyak 4y ago
  > if GPT5 is nearly as advertised, watch the govt swoop in under national security guise Re: GPT5, are there any .. reasonable/credible sources of information on the subject? I've become deaf from all the speculation and while i am very curious, i'm unsure if anything substantiated has actually come out. Especially when considering speculation from Sam himself.
  • blihp 4y ago
    There's barely any credible information about GPT4 (i.e. OpenAI hasn't said very much about what's going on behind the curtain) and there's absolutely none re: any releases beyond that.
  • zarzavat 4y ago
    It’s unlikely to be any time soon. Despite productization by OpenAI, LLMs are still an active area of research. Research is unpredictable. It may take years to gather enough fundamental results to make a GPT-5 core model that is substantially better than GPT-4. Or a key idea could be discovered tomorrow. Moreover, previous advances in GPTs have come from data scaling: throwing more data at the training process. But data corpus sizes have started to peak - there is only so much high quality data in the world, and model sizes have reached the limits of what is sensible at inference time. What OpenAI can do while they are waiting is more of the easy stuff, for example more multimodality: integrating DALL-e with GPT-4, adding audio support, etc. They can also optimize the model to make it run faster.
    • SamPatt 4y ago
      There are diminishing returns from compute time but it looks like even though they are diminishing there's still a fair bit on the table. Though my guess is that GPT-5 will be the last model which gains significantly from just adding more compute to the current transformer architecture. Who the hell knows what comes next though?
    • dougmwne 4y ago
      I keep keep hearing people claim we are at the end of corpus scaling, but that seems totally unfounded. Where has it been proven you can’t running the training set through in multiple epochs in randomized order? Who’s to say you can’t collect all the non-English corpus and have the performance transfer to English? Who’s to say you can’t run the whole damn thing backwards and still have it learn something?
• ftxbro 4y ago
  They've already swooped in. I mean the conspiracy argument would be that the $10B isn't a normal investment. It's a special government project investment facilitated by OpenAI board member and former clandestine CIA operative and cybersecurity executive Will Hurd through his role on the board of trustees of In-Q-Tel the investment arm of the CIA. It's funneled through Microsoft instead of through Google in part because of Google's No-Military-AI pledge in 2018 demanded by its employees, after which Microsoft took over its military contracts including project Maven. The new special government project, the Sydney project, is the most urgent and ambitious since the project to develop nuclear weapons in the mid twentieth century. Of course I don't necessarily believe any of that but it can be fun to think about.
  • xenospn 4y ago
    Who has time to come with this stuff?!
    • poopypoopington 4y ago
      ChatGPT
    • seattle_spring 4y ago
      Most of it seems to come from /r/conspiracy, which unsurprisingly has a lot of overlap with another subreddit that starts with /r/cons*
      • the_doctah 4y ago
        I'd love to go through all the things Liberals labeled a conspiracy in the last 5 years that actually became true, but I don't have that kind of time today
        • slickdork 4y ago
          I'd settle for three examples with sources.