5 ms·
The author is right we know almost nothing about the design and training of GPT-4. From the technical report https://cdn.openai.com/papers/gpt-4.pdf https://cd
by ftxbro 4y ago
The author is right we know almost nothing about the design and training of GPT-4.
From the technical report https://cdn.openai.com/papers/gpt-4.pdf https://cdn.openai.com/papers/gpt-4.pdf : "Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar."
- lovecg 4y agoIt’s amazing how one can found a nonprofit with a goal of conducting “open” research and then end up publishing something like this a couple of years later. Greed is good I guess.
- matheusmoreira 4y agoWe're not publishing any details on the models for safety reasons! Also would be great if the government cracked down on our competitors because they don't care about safety like we do.
- deleted 4y ago[deleted]
- jazzyjackson 4y agoRight, safety is a moat. If you don't meet the standards of the closed model you won't be allowed to exist.
- startupsfail 4y agoWhat is OpenAI is right and the risks are real? They likely already have some glimpses of GPT-5 internally. And GPT-4 is closely resembles AGI already.
- anileated 4y agoThat’s the excuse they’ll use when they convince the government to require a special license to buy powerful GPUs.
- rnk 4y agonvidia won't go for that.
- thatguy0900 4y agoThen it really doesn't matter, because in <10 years all the bad actors who are interested will have made it already. Might as well let people know that they can't trust anything anymore upfront rather than pretend.
- jazzyjackson 4y agothe risks that a text simulator without gaurdrails will be able to generate text we don't like? Or that someone will automate cyberattacks, as if the government isn't already doing it? my greatest fear is that there is only one superintelligence, with access controlled by a monopoly of a few san franciscans deciding what moral boundaries AI will have. I couldn't even get Claude+ to talk to me about houses of zodiac because it insisted it's not an astrologer, it's an AI assistant designed to be helpful blah blah blah, tell me what use is this kind of "safety"?
- saiya-jin 4y ago
- deleted 4y ago[deleted]
- amf12 4y ago"Safety". As if they cared enough about it with ChatGPT. Its purely for competitive reasons because of they hype that was generated.
- noncoml 4y agoGenuinely can't tell if this is sarcasm or not..?
- matheusmoreira 4y agoIt is.
- gilgoomesh 4y agoYou're implying that open research is a shady way to become a non profit. They're allowed to change their business model. The open research was published at the time. GPT-2 is fully open source. Even GPT-3 was open source through the beta in 2020. What they didn't release was the fully trained model (the data is more valuable than the code, in this case).
- colordrops 4y agoNo one is suggesting they are doing something that isn't allowed. The poster you are replying to is allowed to criticize them.
- int_19h 4y agoLegally, yes, they can do that. Ethically, this is a very clear example of bait and switch.
- visarga 4y ago"Open"AI is how people write it
- whitemary 4y agoGod bless these saviors for prioritizing our "safety!"
- misssocrates 4y agoIs this the new "think of the children"?
- Nevermark 4y agoYes, it now is "Think of the humans!" For now its AI companies, with people, protecting us from powerful tech. Soon it will just be the AI's protecting us from powerful tech. Am I joking? Maybe? Maybe, not? I don't know! Everything around this new tech is moving too fast, and been too unpredictable. And here I am, writing this manually, every word is mine, on a computer that I can't talk to yet. That already feels so 2022. Only one thing is certain. Siri is now to Apple, what Clippy was to Microsoft, on a far far planet, long long ago.
- behringer 4y agoAs my friend who is a professor likes to say, it's great they've given AI safety controls while making it dead simple for a student to write a good thesis. I think they need to review their ethics, personally.
- mr_toad 4y ago> Is this the new "think of the children"? As in it’s not about the children, it’s about control? Yes.
- badRNG 4y ago> As in it’s not about the children, it’s about control? Yes. I don't think the motives are insidious or about maximizing control, they are strictly profit driven. If you want the world building their apps on your AI, you need to do absolutely everything in your power to make the AI brand safe. Previous chatbots have been easily coerced into saying truly awful things (e.g. Tay), and the models themselves became associated in the minds of the public with hate speech. You can't have Khan Academy or Microsoft Word potentially going on racist tirades in the midst of chatting with a student or taking meeting notes.
- oxfordmale 4y agoGPT-4 is an amazing achievement, however, it is just a language model. LLM (large language models) are well documented in literature and GPT-4 is just a much larger version (more parameters) of these LLM models. Training of LLM models is also well documented. GPT-4 just has been trained on a very large subset of the Internet. Of course there are proprietary models, that will be improved versions of the academic LLM models, however, there are no big secrets or mysteries.
- woeirua 4y agoI'm not so sure about this. There is speculation that GPT4 may utilize additional specialized models underneath it for specific tasks.
- precompute 4y agoExactly, this has been my guess as well. They must have trained the model specifically to write poems, haikus and other things. So that the output looks much more polished than it really is.
- euroderf 4y agoI for one want a module that plays around with physics models and proposes practicable FTL-capable mechanisms.
- precompute 4y agoThat'd require a real AI and not just a LLM, haha.
- int_19h 4y agoThe individual components are well documented, but which specific arrangements produce the best results is still very much an active research area. As far as training, the differences between GPT-3 and GPT-3.5 (the latter being a smaller model!) demonstrate just how much fine tuning and reinforcement learning is important to the quality of the model. Merely throwing more content from the Internet at it doesn't automatically improve things.
- andreyk 4y agoAlmost nothing is quite an exaggeration - we know a whole lot about GPT3 (their paper was quite detailed), and even if OpenAI made some tweaks beyond RLHF the underlying model and training objective are most likely the same.