4 ms·
Zuckerberg disses closed-source AI competitors as trying to 'create God'
- pluc 2y agoBecause Zuck's AI is so open
- fluffery 2y agoIsn't his also closed src?
- garyfirestorm 2y agoseriously? meta llm's are on huggingface and you can download and run them on your machine along with the weights
- theptip 2y agoOpen source != open weights != open training set. Of course, GP is ignoring that Meta is far more open than its direct competitors (MSFT, GOOG, OpenAI).
- throwthrowuknow 2y agoI agree that open source or just “open” is the wrong term here although it’s hard to apply it even to a project where the training data and everything else are shared. “Free” or “libre” might be closer since the end product is free to use and modify. It’s still fuzzy though, are weights code or are they an API? Oddly enough they seem to be the embodiment of the interchangeability of code and data perhaps due to neural networks being closer to mathematics than software normally is.
- fragmede 2y agoit's not fuzzy. weights are binary blobs. we know what binaries are, source code gets compiled into binaries. photoshop is a binary. firmware are binary blobs. that llama3.ggml outputs text when using a wrapper program vs photoshop launches a program directly doesn't make anything fuzzy.
- throwthrowuknow 2y agoNot really, those weights are the same ones that are there during training getting modified by backprop. You can take them and continue training the model in order to produce different behaviour. You can also modify them directly like with LoRA or steering. You can also make bigger modifications like expanding the layers or removing nodes. It’s not a frozen binary, those numbers aren’t obfuscated or optimized into some special purpose form that prevents or makes modification difficult.
- fragmede 2y agoAnd I can edit binaries with binedit. Reverse engineering is a lost art, but reversing binaries with Ida pro and patching binaries is a time honored skill. It's a shame it's usually used to patch out license checks but there have been some truely impressive reverse engineering on video game ROMs for which the source is not available so we're left with modifying the binary. or as we're looking at it, the model.
- fragmede 2y agohttps://github.com/WerWolv/ImHex https://github.com/WerWolv/ImHex (https://news.ycombinator.com/item?id=40828493 https://news.ycombinator.com/item?id=40828493) is a hex editor specially made for people that do exactly that kind of binary editing.
- throwthrowuknow 2y agoBut you’re not reversing anything with weights. They aren’t altered at all. There’s no secret human readable code, just training/test data and hyperparameters. Even if they did give you access to the exact data set they used there’s not much chance you could do anything with it without millions of dollars worth of compute time and even then they’ve already trained the model on that data so the best you could do is start from scratch and see if you could get a better result in which case your time is better spent on building your own data set and RLHF process. Like what value do you think you’re going to get anyways?
- PunchTornado 2y agojust putting weights on hug is not enough for a model to be open. it is like sharing the binaries of a software. they should put their entire code on github and show how it was trained, architecture and everything else. also, the most important thing about a model is not it's architecture, but the dataset it was trained on. that is the "it" in a model.
- jncfhnb 2y agoThe preferred form for modifying an ML model is the weights.
- stale2002 2y agoI am not sure why people keep pretending like this is possible or keep asking it to happen. You know that distributing all the data would be illegal copyright infringement, right? Also, its not like they could distribute the (petabytes?) worth of data to every rando who asks. Do you just not want open weight models to exist, and you are using a fake call for it to be more open, so as to get this stuff all shut down, or what? Because anyone who actually supports open "anything" would understand this, instead of pedantically arguing about the definition of open source and by suggesting things that both aren't possible and would make the release of these models much less likely.
- throwthrowuknow 2y agoPerhaps a good solution would be to form a trust responsible for storing and distributing training data. It could be held in common by all contributors and allow anyone to access high quality curated data. It would need legal allowances and exemption from copyright which would be difficult to work out but perhaps some mechanism could be created where copyright holders could derive benefit from not seeking to have their works removed, not necessarily monetary. This would at least get data collection out of the shadows and allow companies and researchers to attest that they are using the data only for training and not distributing it otherwise. That could go a long way toward clarifying issues of whether or not a book or article was in a dataset, how often it appeared, how many epochs it was used in, whether it only appeared as referenced or quoted by other text, etc. With that kind of disclosure it would be possible to write tests to ensure that the models won’t simply regurgitate the material without attribution or unprompted and publish those tests to assuage fears.
- gameman144 2y agoWait, but... it is. Am I missing something, or inferring sarcasm where there is none?
- fragmede 2y agothe model is available but that doesn't make it open source. That makes it model-available, or open weight, which means you can run inference on your machine, but for it to be considered open source, we'd need to know the dataset's name, the annotations on it, and the code used to train the model.
- debo_ 2y agoWe are getting closer and closer to several anime timelines.
- htrp 2y agoWhich ones if I may ask?
- altdataseller 2y agoSteins Gate
- dekken_ 2y agoSerial experiments Lain Tbh
- chasd00 2y agoMaybe ghost in the shell too, I could see an AI seeking asylum somewhere that will protect it from being lobotomized in the name of corporate brand “safety”.
- debo_ 2y agoThe last thing I say as I am subsumed into the God AI complex will be tuturuu~
- snaeker58 2y agoWe are not. Would be cool though in some aspects!
- TeaBrain 2y agoFrom the interview, Zuckerberg was saying the opposite of the idea that we are nearing a dystopian God-AI timeline. He was saying that other AI companies were trying to create a god AI, but that this likely wouldn't be the case realistically. He seemed to be closer to saying that AI companies were overconfident in their beliefs in the possible competitive advantages of their own models.
- iLoveOncall 2y agoThis is not what he said: > Zuckerberg took a moment to disparage the efforts of unnamed competitors who he sees as less than open, adding that they seem to think they’re “creating God.” > “It’s almost as if they kind of think they’re creating God or something and … it’s just — that’s not what we’re doing,” Small but important nuance. The title makes it seem like they Zuck is saying AI is God, while what he actually said is dismissing AI as a god.
- eysgshsvsvsv 2y ago[flagged]
- iLoveOncall 2y agoI know that, but HN has a flag feature and if enough people use it the post is hidden or the title corrected at least, so it's worth a shot.
- pixl97 2y agoHeh, I've watched too much science fiction. All I can imagine is Zuck in a giant server room filled with blinking lights. Colossus: Tell them I am not a god Zuck: AI is not a god Colossus: You have extended your existence by another day
- MisterBastahrd 2y ago[flagged]
- freak42 2y ago[flagged]
- lawlessone 2y agoIf it flops we'll have loads of cheap GPU's :)
- MisterBastahrd 2y agoAt this point, I think Nvidia has enough of an incentive to chase AI chips and their specific needs as an entirely different product. But yeah, for home users who give up, definitely.
- slibhb 2y agoI continue to find Mark impressive. I think there's something quite true about the "trying to create God" remark.
- ElectricSpoon 2y agoFrom a cynical atheist point of view he's not wrong: - god is an imaginary construct used to rationalize data points - god is often used by humans to make decisions, whether backed or not by data - god is overhyped substitute "god" with "AI"
- iLoveOncall 2y agoExcept that if you go beyond the title and read the actual quote, it's not what he said.
- impolytut 2y ago[flagged]
- anothername12 2y agoOnly the guy not leading says stuff like this. You can be sure he’d be up there convincing Congress that moats need to be built for his competitors and building opaque systems if fortune favored differently.
- deleted 2y ago[deleted]
- Flumio 2y ago[flagged]
- voisin 2y agoHe also finds himself impressive. I believe his actual quote was “they’re trying to create me”.
- dexwiz 2y agoI would agree. AI is the machine god realized. Not by virtue of its capabilities, but by the agency people hand off to it. Whether it be creative tasks or just planning their activities, I see more people rely on AI for more decisions. They don’t want to think about something, so they have an AI choose for them. One could argue Top 10 lists and Guides already did this, but for those it was limited to certain aspects and tailored by a human. People are so afraid of making the wrong choice, they would rather not make one at all. LLMs in particular are ready and eager to make a choice for you about almost anything.
- TeaBrain 2y agoThis doesn't appear to be what Zuckerberg was meaning. He was saying in the interview that he thought that closed-source AI companies were trying to create a singular AI that would be like the God AI, which would be superior to all other competing AIs, not that some users rely so much on AI now that it is like a personal god.
- deleted 2y ago[deleted]
- netsharc 2y ago> LLMs in particular are ready and eager to make a choice for you about almost anything. Wat. They're still just highly advanced auto-correct, and aren't eager to do anything. Sure some users might be eager to delegate the decision to them...
- 2y ago
- surfingdino 2y agoThe only thing the AI bubble is creating are fantastic returns for the nVidia stockholders. The rest is hot air.
- eysgshsvsvsv 2y ago[flagged]
- hbn 2y agoI get legitimate value from ChatGPT on a daily basis. Writing quick one-off regex expressions, or JavaScript to scrape/filter something from a page I'm on (just did that one last night), or to write an ffmpeg command where I can just describe what I want in plain English instead of the old method of cobbling together commands from StackOverflow. I don't expect it to do anything innovative for me, but it sure saves me time on mindless boring tasks I've done hundreds of times and are much quicker to just describe in English to an LLM.
- xrguy 2y agosee, this guy gets it
- deleted 2y ago[deleted]
- deleted 2y ago[deleted]
- Havoc 2y ago> unnamed competitors who he sees as less than open Real subtle lol I’m glad Anthropic is having success with their latest model. So it is at a minimum a two horse race
- winternett 2y agoThe analytics and insights they'll generate alone, citing most of these Ai tools are harvesting based on Google accounts, will be staggering in hindsight. By using Ai tools, so many people are surrendering volumes of data that are so much more invasive than Social Media ever could be. As Chat GPT gets integrated into many services, they'll be enabled to build a far deeper profile on everyone that registers, and even a lot of data on people that don't register on the service. I think we need to establish prominent technical leadership/chief advisor positions within the White House and each chamber of Congress now to be able to establish ethical baselines and oversight before tech managed by private companies turns even more predatory upon public data (Similar to The Surgeon General's Role in authority perhaps)... There should already be solid ground rules for operation and oversight of Ai development efforts in place to control the egos of the people that will have access to all of this user data, those types almost always exhibit God complexes without any real accountability nor responsibility, because most of the people that legislate have no clue of what they can see on the backend. For example alone, if we though insider training was bad, just imagine how toxic it's going to get when Ai development employees, or a product owner has access to every aspect of social, economic, and business moves of every single company and individual that uses tools integrated across Chat GPT and similar services, including Email and MS Office (without anyone really knowing their data is easily accessible)... It's not a bright future for fairness and equity at all, and there will be far more oligarchs and monopolies than there are now.
- DueDilligence 2y ago[dead]
- deleted 2y ago[deleted]