6 ms·
AI That Teaches Other AI
- vouaobrasil 3y agoThe lead researcher said in this article, "Humans have the means of sharing information. We are now pushing that idea into the AI domain." A classic example of human hubris...thinking that we will be able to control and benefit from the results of such inventions. It boggles my mind how some people are so naive to think that this is just an academic game without real-world consequences that are likely to be devastating.
- Kiro 3y agoAnd it boggles my mind that you confidently make such extreme claims.
- firewolf34 3y agoThe modern development of AI can be likened to the earlier development of the atom bomb. Everyone thinks it will destroy the world because technically it has the potential to do so and everyone's a pessimist on average. But it'll probably not be nearly as bad as claimed. Us humans have a strong tendency to enjoy being alive and preserve doing so.
- pixl97 3y agoThe atom bomb is an extreme device, the issue is the extremeness is multi-polar. Atom bombs have extreme explosions, but they also require extreme maintenance, extreme precision in manufacturing, and are extremely detectable. For AI the level of extremeness has not been defined. Yea, it requires extreme manufacturing, but it's the same manufacturing that builds billions of chips per year that are distributed almost everywhere. A server farm running AI looks much the same as a server farm running other computing tasks. Coming back to atom bombs, yes, atom bombs could destroy the world 10 minutes from now, and every 10 minutes from now until we destroy enough of them they can no longer do that. It simply has not happened yet and we've likely been very very lucky that it has not happened. Lastly, AI, especially when we reach AGI, is intelligence which means it will likely have some hand in if the world is destroyed or not. This risk rapidly increases if AGI capabilities are far beyond human capabilities.
- cubefox 3y agoAtom bombs are just tools, they are only controlled by humans. But a super intelligence can be an actor, not just a tool. This changes everything. It might be vastly more intelligent than humans. It wouldn't be limited by skull size, meager energy provided by food, or low spike frequency of biological neurons. The difference might be as large as between humans and chimpanzees, or humans and mice, or even humans and ants. There is no reason to expect we are anywhere near the theoretical peak of intelligence.
- vouaobrasil 3y agoWhy? Every day the rest of the world make confident extreme claims that AI/advanced technology/STEM will improve the world with zero evidence either, and no one ever challenges those. In fact, everyone just jumps on the happy "tech is the best" bandwagon with nary a thought. If you think I'm making extreme claims, go look at the one-sided only positive view of technology being espoused by everyone else. On the other hand, technology has brought us to the brink of a climate disaster and a screwed up society (just look at how much research there is for the damaging effects of social media).
- firewolf34 3y agoSo you've realized that one side of the extreme is irrational because it's extremely over-positive, and decided you'd just jump on the other side of the irrational extreme over-negative to be contrary? Saying AI will save the world is just as irrational as saying it will destroy it. By your own admission, even.
- vouaobrasil 3y agoWell, I don't think my statements are extreme actually. I've given them a lot of thought and reasoned them out more fully elsewhere. I do sincerely believe AI has the capability to make society significantly worse and even destroy it through its isolating effects and through its removal of purpose from humanity. Of course, these comment boxes are a little small to have extended discussions but I'm perfectly willing to hear any serious arguments against what I have to say.
- blackbear_ 3y agoDo you have a blog or website with your thoughts on this?
- vouaobrasil 3y agoYes I do. I'm not sure it's allowed to link here but it's blog.jpolak.org. Some posts are quite long with much more detailed analysis and arguments. I also recommend David Skrbina's "The Metaphysics of Technology" although my posts and thoughts are independent of that book.
- pixl97 3y agoIntelligence is extremism. It is the most potentially extreme agent in the universe because it allows you to control all other forms of extremes. When humans intelligence grew beyond that of the other animals, we became the masters of those animals. We can choose to manipulate them, control them, or if they cannot be controlled, destroy them. Now, I don't understand why saying "There is no particular reason why humanity is the highest form and capability of intelligence" would be an extreme claim in any way. At least to me, the opposite is true "Humans are the most capable form of intelligence possible" is a anthropocentric and extreme statement.
- classified 3y agoDon"t panic, this is just the full autmation of enshittification. Producing piles of worthless ouput without human assistance. Nothing too dramatic, really.
- yontach 3y ago[flagged]
- yeldarb 3y ago> Their SKILL tool involves a set of algorithms that make the process go much faster, they said, because the agents learn at the same time in parallel. Their research showed if 102 agents each learn one task and then share, the amount of time needed is reduced by a factor of 101.5 after accounting for the necessary communications and knowledge consolidation among agents. This is a really interesting idea. It's like the reverse of knowledge distillation (which I've been thinking about a lot[1]) where you have one giant model that knows a lot about a lot & you use that model to train smaller, faster models that know a lot about a little. Instead, if you could train a bunch of models that know a lot about a little (which is less computationally intensive because the problem space is so confined) and combine them into a generalized model, that'd be hugely beneficial. Unfortunately, after a bit of digging into the paper & Github repo[2], this doesn't seem to be what's happening here. > The code will learn 102 small and separte [sic] heads(either a linear head or a linear head with a task bias) for each tasks respectively in order. This step can be parallized [sic] on multiple GPUS with one task per GPU. The heads will be saved in the weight folder. After that, the code will learn a task mapper(Either using GMMC or Mahalanobis) to distinguish image task-wisely. Then, all images will be evaluated in the same time without a task label. So the knowledge isn't being combined (and the agents aren't learning from each other) into a generalized model. They're training a bunch of independent fine-tuned models for specific tasks & adding a model-selection step that maps an image to the most relevant "expert". My guess is you could do the same thing using CLIP vectors as the routing method to supervised models trained on specific datasets (we found that datasets largely live in distinct regions of CLIP-space[3]). [1] https://github.com/autodistill/autodistill https://github.com/autodistill/autodistill [2] https://github.com/gyhandy/Shared-Knowledge-Lifelong-Learning https://github.com/gyhandy/Shared-Knowledge-Lifelong-Learnin... [3] https://www.rf100.org https://www.rf100.org
- koheripbal 3y agoIt challenges the notion of individuality. Where does one AI begin and another end? A distributed super-intelligence is exciting. It will be interesting how long it can remain aligned with itself.
- 3y ago
- ape4 3y agoDoes this allow modules? For example could a general AI's (like chatGPT) poker module be updated independent of its other abilities.
- e12e 3y ago> with applications in medicine and beyond Cybernetics? ;)
- e12e 3y ago> Or imagine every smartphone user is a local tour guide in the city he or she is visiting. Each user takes photos and provides details about significant landmarks, stores, products, and local cuisine. WikiTravel?
- theknocker 3y ago[dead]
- benterix 3y ago> After consolidating their knowledge, Itti and Ge explained, these AIs could serve as a comprehensive medical assistant, providing doctors with the latest, most accurate information across all areas of medicine. As for the "most accurate" part, I would agree if at the same they provided the source of each bit of information. Otherwise it would be just speculation with varying levels of probability.
- PeterStuer 3y agoDon't they run into the meta-dilemma? In semantics I had this problem that whenever you moved from an single integrated domain (utopia), to a selection of specialized micro domains (feasible), the problem became a tradeoff between on the one hand selecting the right 'expert', and on the other hand integrating the 'knowledge' of the various experts. For each specific instance of this type of problem you can strive to improve the tradeoff, but there is no 'general' solution'.
- roschdal 3y agoThis is the end for humanity.
- idiotsecant 3y agoIt's probably the end for our image of a dominant purely biological humanity. This isn't so bad or unexpected though. We are just the latest step in the universe's growing comprehension of itself. At one point the self-replicating molecule was the most advanced cognition available in our little corner of reality, then at various times we had single celled organisms, colonial organisms, etc etc until eventually we got humans. There have been phase changes in the nature of cognition many times, this will just be the latest. What comes next is just the latest link in a chain of continuous increasing complexity of life stretching back to the first time a couple of organic molecules reacted. It's exciting to be alive in a time when we get to see one of these phase changes. It's like being alive at the dawn of civilization or when the first fish crawled out onto land.
- p1esk 3y agoIt's probably the end for our image of a dominant purely biological humanity. This isn't so bad Sounds pretty bad
- idiotsecant 3y agoWhy?
- carbocation 3y agoI'm a bit confused as to why a Mixture of Experts (MOE) isn't one of the comparators. That seems like the most relevant direct comparator, rather than the several other paradigms that they cited.
- andreyk 3y agoMoE is a type of neural network architecture, not an approach to lifelong learning. As they say " We propose a new Shared Knowledge Lifelong Learning (SKILL) challenge, which deploys a decentralized population of LL agents that each sequentially learn different tasks, with all agents operating independently and in parallel." What they propose is effectively an MoE with separately learned routing as far as I can tell, with the heads of the LLM being task specific and there being a task mapper to assign training labels. The baselines based on Parameter-Isolation methods are sort of similar MoEs, in that additional weights are added and trained on each tasks (somewhat as experts would).
- 6gvONxR4sf7o 3y agoThere are network architectures for MoE, but afaik the concept of MoE is separate from them. MoE at least significantly predates the last decade's neural network boom.
- andreyk 3y agoafaik the term MoE is generally used in the context of neural networks, with the term mixture models being more general. But you are right it's not exclusive to NNs.
- carbocation 3y ago> What they propose is effectively an MoE with separately learned routing as far as I can tell, with the heads of the LLM being task specific and there being a task mapper to assign training labels. What you are describing would indeed be an MoE model, but that's not where it ends. The manuscript continues [1]: "all agents become identical after all tasks have been learned and shared, and they all can master all tasks." That is a substantial divergence from the MoE model! To the extent that there is an MoE-like stage in their training, I think it's odd that the term "mixture of experts" is not mentioned nor is the literature on the topic cited. 1 = https://openreview.net/pdf?id=Jjl2c8kWUc https://openreview.net/pdf?id=Jjl2c8kWUc
- stormfather 3y agoHow is this better than training 102 small task-specific models, and 1 model that routes to them?