6 ms·
I notice a few people lamenting that OpenAI will no longer be... open. But I have to wonder, in what sense is OpenAI open today? In 2019, OpenAI transitioned
by andsoitis 4y ago
I notice a few people lamenting that OpenAI will no longer be... open.
But I have to wonder, in what sense is OpenAI open today?
In 2019, OpenAI transitioned from non-profit to for-profit. At that time, Microsoft invested US$1 billion into the company. OpenAI then announced its intention to commercially license its technologies.
- visarga 4y agoOpen for people with money. Open demos for everyone else (limited time).
- specialist 4y agoJust like Freemium Speeches™.
- lairv 4y agoStill more open than Google, Microsoft or DeepMind
- andsoitis 4y agoIn what specific ways? Google and Microsoft both release and contribute to open source software. They both publish vast amounts of research. What does OpenAI do differentially?
- lairv 4y agoThey at least give access through paid API to their latest models, which hasn't been the case for Imagen, Parti, LaMDA (google), Flamingo, AlphaGo, AlphaZero, AlphaStar, AlphaCode, AlphaTensor (DeepMind), Make-a-scene, Make-a-video (Meta)
- PartiallyTyped 4y agoI don't think DM was open in any meaningful way other than publishing research. It took a long time until their source code became public, and replication of certain papers is problematic to say the least. Similar issues exist with some G.Brain papers not releasing code publicly years after acceptance. But all of these are anecdata from a random person on HN so take with a grain of salt.
- SquareWheel 4y agoAre we forgetting TensorFlow? It played a part in starting this whole AI revolution.
- scaredginger 4y agoYes, we're all aware it's common practice to open source code. However, if the weights aren't provided and the data is unavailable or the compute is expensive, the code is worthless.
- mannerheim 4y agoDoes OpenAI provide weights, data, or even code?
- orra 4y agoThey sometimes provide code, and less often pre-computed models. But we're not talking about their crown jewels, so the name OpenAI is completely misleading.
- CJefferson 4y agoMore open than Google and Microsoft? There is loads of open source I can download that Google and Microsoft created and released. What has OpenAI ever released?
- Traubenfuchs 4y agoDon't forget its ever increasing wack a mole game of non-openness in regards to censorship, wrongthink and pornography.
- sekai 4y ago> Don't forget its ever increasing wack a mole game of non-openness in regards to censorship, wrongthink and pornography. That's because they want to make money, good luck attracting investors when your tool lists benefits of Nazi ideology or generates minor porn novels.
- davidguetta 4y agoI think it's still crazy that in 2022 the fact that some stupid people can be offended by that have that much importance.
- sekai 4y agoeh, it's all PR, no one really wants to be associated with that, one of the reasons why Apple forced Tumblr to remove porn which in turn decimated Tumblr's user base.
- redox99 4y agoThat makes very little sense. Is absolutely anyone going to decide against buying an Apple device, because Tumblr is on the App Store?
- trifurcate 4y agoI absolutely can believe that some households are going to buy Apple devices because they can be relatively sure that their kids won't find porn on the App Store.
- cmeacham98 4y agoIs it possible, maybe, that it's not "some stupid people" with "much importance" - but actually the average person doesn't want technology to vocally support neo-nazis? To be honest I don't really care either way (at least in this case), but I see people making this argument always act like it's a few elites ruining the world and it's impossible that the average person doesn't 100% agree with them.
- CJefferson 4y agoEDIT: A reply points out this message was wrong, I was accusing AlphaGo and AlphaZero of being closed, but that was Deepmind, not OpenAI.
- deleted 4y ago[deleted]
- mannerheim 4y agoAlphaGo and AlphaZero are Google/Deepmind, not OpenAI. They've released papers, and there's a model that reproduces the paper. https://en.wikipedia.org/wiki/Leela_Zero https://en.wikipedia.org/wiki/Leela_Zero
- CJefferson 4y agoFirstly, you are right about deepmind vs openai, woops. While they released papers, I personally wouldn't have been happy reviewing the paper, because it was basically impossible for anyone to check (given how long Leela Zero took to get up to the same level). Releasing the network via bittorrent would have been very low cost. I am impressed by Leela Zero, and independant duplication is still important, but it would have been even better to be able to directly compare it to AlphaZero & AlphaGo, rather than having them locked up.
- mannerheim 4y agoYes, I wonder what the secrecy is about, several years later.
- Q6T46nT668w6i3m 4y agoDeepMind has an excellent track record of helping other researchers reproduce their work. OpenAI does not.
- jrochkind1 4y agoI don't have any answer or opinion on whether the company "is open", I'm not sure how to operationalize that. But what you can say is that some but not all of their released products are released with code under open source licenses. Eg: https://github.com/openai/whisper/blob/main/LICENSE https://github.com/openai/whisper/blob/main/LICENSE (an actual product, to transcribe audio, which it really does extremely well; and it's open source code; released last fall) So that's one sense in which they produce "open" things today. I would personally expect that all of their "openness", from the currently free trial (but not open source) cloud-hosted products, to the code released as open source licenses -- are part of a business strategy to get awareness of the technology and of them as a brand, and buy-in, and can/will be changed at any point if it makes business sense. As we increasingly see with so many companies that start out even all-in with open source. (Say, elasticsearch). I think we should assume almost any for-profit company producing open source is in this category. I think their name is a marketting gimmick to make people assume they are some kind of academic non-profit. I don't know if it's obvious what a Microsoft purchase might do to those plans/timelines. In some ways MS's deep pockets might mean that free and/or open source offerings can persist longer, extend the metaphorical runway. MS will definitely want to be known as the authority on AI, and making sure people keep seeing your stuff to be impressed by it, and making sure it gets used by enough people to stay "the standard" is how you do that.
- londons_explore 4y ago> some kind of academic non-profit. I think this image was also important for hiring their researchers. You'll successfully pull people from academia with the lure of lots of money and resources and the openness that they're used to from the academic world.
- 93po 4y agoThese code bases are effectively worthless without the training, which is definitely not open.
- jrochkind1 4y agoYeah, that's a good point. Whisper is useful as a tool to transcribe audio though. Like you can just use it to do that, without having any idea how it works, and it does that well, and it's free. But yeah, it's not exactly "open source"... I mean technically the code and models in the repo is, but I get that's not enough if you actually wanted to develop/improve/fork the actual workings. But it is a working transcriber, that can be used for free, with a license such that it will remain so!
- soperj 4y agoIt's as open as OOXML!
- londons_explore 4y agoNearly everything openAI has showcased at least has a publicly published paper on how to reproduce what they have done. Sure, it isn't as good as source code and model weights... But having a paper probably reduces by 90% the time+money expense to reproduce the work.
- mannerheim 4y agoDepends on what models we're talking about. I've heard reproducing ChatGPT would require on the order of ten million dollars' of compute.
- matmatmatmat 4y ago$10 MM of compute doesn't seem all that out-of-reach for most "mid-size" companies, especially if the result is economical.
- mannerheim 4y agoI don't think the result is economical purely because if it were, Google would be monetising their own models by now (of course, maybe they could monetise it if they were willing to go with a paid instead of ad model for search).
- boplicity 4y agoI think there are a lot of assumptions that Google hasn't already integrated this type of technology into their search engine. I suspect they have, but they've done so conservatively, to avoid changing how their "Golden Goose" lays eggs.
- justapassenger 4y agoThat's cheap for an AI model training at big tech. Your average ads model engineer at those companies likely uses more compute each quarter. It mostly suggests that we're in another AI hype bubble. MS and other big tech companies can easily replicate OpenAI results and do same type of research.
- dnissley 4y agoThere was a thread on this the other day: https://news.ycombinator.com/item?id=34301637 https://news.ycombinator.com/item?id=34301637 My answer: I think it's that they intend to make AI into a product that can be sold, as compared to e.g. Google or other companies which develop AI internally but only use it to augment their existing portfolio of products.
- jpadkins 4y agoAccessibleAI is probably a more accurate name than OpenAI. But not as snappy.