21 ms·
Rodney Brooks on limitations of generative AI
- deleted 2y ago[deleted]
- TheOtherHobbes 2y agoThe iPod didn't stop growing. It turned into an iPhone - a much more complex system which happened to include iPod features, almost as a trivial add-on. If you consider LLMs as the iPod of ML, what would the iPhone equivalent be?
- christianqchung 2y agoI'd rather consider the current generation of LLMs as the first iPhone (or maybe flip phone, depends on where you stand), given that hundreds of billions of dollars in private money is already going into developing them.
- ilaksh 2y agoLarge multimodal models. Maybe using diffusion transformers. Possibly integrated into lightweight comfortable AR glasses via Wifi so they can see everything you can, optionally automatically receiving context such as frame captures. Optionally with a very realistic 3d avatar "teleported" into your space.
- bamboozled 2y agoHe made an analogy to discuss the business case for scaling an iPod, not whether or not new products and services would be invented. My iPhone still only has about 64gb of storage.
- mewpmewp2 2y agoBut it is the dumbest thing in the World to compare features of LLM to something like that.
- bamboozled 2y agoThat is your opinion I guess, have a nice day.
- ImaCake 2y agoProbably the kind of intuitive AI assistant you can find in a lot of science fiction works. A virtual assistant that can search the web for you, write/proofread an essay, analyse social situations, and enrich the right bits of your personal information for you. Basically a smart assistant integrated into a vr headset.
- ianbicking 2y ago"He says the trouble with generative AI is that, while it’s perfectly capable of performing a certain set of tasks, it can’t do everything a human can" This kind of strawman "limitations of LLMs" is a bit silly. EVERYONE knows it can't do everything a human can, but the boundaries are very unclear. We definitely don't know what the limitations are. Many people looked at computers in the 70s and saw that they could only do math, suitable to be fancy mechanical accountants. But it turns out you can do a lot with math. If we never got a model better than the current batch then we still would have a tremendous amount of work to do to really understand its full capabilities. If you come with a defined problem in hand, a problem selected based on the (very reasonable!) premise that computers cannot understand or operate meaningfully on language or general knowledge, then LLMs might not help that much. Robot warehouse pickers don't have a lot of need for LLMs, but that's the kind of industrial use case where the environment is readily modified to make the task feasible, just like warehouses are designed for forklifts.
- jsemrau 2y agoI am a perfectly healthy human being, but I can't climb Mount Everest (right now). I might be capable with more training.
- danielmarkbruce 2y agoIt might seem silly... but that's likely because you understand them better than most. He is talking about a real human problem - we see a thing (or person) do X well, and assume it's the result of some very general capability. With humans we tend to call it "halo effect". People are seeing LLMs to some insanely good stuff but don't know how they work and assume all kinds of stuff. It's an "AI halo effect".
- enragedcacti 2y agoI don't think you and him are in disagreement. I read it as him saying "evaluating LLMs is extremely difficult and a big problem right now is that many people are treating them as basically human in capability". Its the opposite problem to the perception of computers in the 70s, early computers were seen by some as too alien to be as useful as a person across most tasks, llms are seen by some as too human to not be as useful as a person across most tasks. They are both wrong in surprisingly complex ways.
- mjburgess 2y agoWere one to slice the corpus callosum, and burn away the body, and poke out the eyes.. and pickle the brain, and everything else besides... and attach the few remaining neurones to a few remaining keys.. then out would come a program like ChatGPT's -- "do not run it yet!" the little worker ants say dying on their hills, out here each day: it's only version four -- not five! Queen Altman has told us: he's been busy in the hive -- next year the AI will be perfect it will even self-drive! Thus comment the ants, each day and each night: Gemini will save us, Llama's a delight! One more gigawat, One more crypto coin One soul to upload One artist to purloin One stock price to plummet Oh thank god -- it wasn't mine!
- georgeecollins 2y agoThat's really nice-- did you just make that?
- mjburgess 2y agoI did.
- unraveller 2y agoDo run it now! Don't worry about where it sleeps in your tool cabinet so much. Put that fastidiousness to better use by reaching in with your intellect to see what favorable positions you can tickle the LLM into. None to be found you say? In the tool world an LLM is closer to a mirror than a hammer.
- lukeschlather 2y agoI feel like "generative" might be the worst possible label, because while the generative capabilities are the most exciting features, they're not the most useful, and in most cases they aren't useful at all. But the sentiment analysis, summaries, and object detection seem incredibly capable and like the actual useful features of LLMs and similar tensor models.
- ImaCake 2y ago"Generative" is a great technical term for LLMs because it is what they do. But it a bad marketing term because it doesn't describe what they can do well. >object detection This comes from a different class of machine learning models unless I am mistaken?
- lukeschlather 2y agoMultimodal ChatGPT and Gemini both seem pretty good at identifying objects in images.
- spacecadet 2y agogen ai is dunning-kruger
- RecycledEle 2y agoChatGPT and other world-knowledge AIs are proven super intelligences in that they have a broader range of knowledge than any human who has ever lived and they are faster than any human who has ever lived. Anyone who can not acknowledge this lacks the discernment to understand that when they ask a computer program a question and get an answer no human could have given, that is super intelligence.
- t0bia_s 2y agoI use Midjourney for my work here and there. It let me done job faster, however it would be useless without my years of experience with visual production. It still require knowledge of postprocessing, drawing, imagination, photomanipulation, creating assets... And a taste which is subjective but it helps a lot. Aesthetic is complex subject but cannot be generated if task is more precise.
- bilalq 2y ago> Panasonic Professor of Robotics Emeritus at MIT Can someone translate what that means? I'm struggling to read past that line, since I just can't wrap my head around what a "Panasonic Professor" is. Does that word refer to something other than the corporation in this context?
- Dr_Birdbrain 2y agoI think it means it’s an endowed chair, where the endowment is provided by Panasonic. It’s common for corporations or wealthy individuals to donate large amounts of money to fund prestigious academics.
- gjvc 2y agoAmara's law -- "We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run."
- Viliam1234 2y agoAlso, the author focuses on the fact that LLMs are not much better at things that robots already do, such as moving stuff in a store. Yeah. But they are surprisingly good at many things that robots already didn't do, such as writing texts and composing songs. It's like getting a flying car and saying "meh, on a highway it's not really much faster than the classical car". Or getting a computer and saying that the calculator app is not faster than actual calculator. A robot powered by some future LLM may not be much better at moving stuff, but it will be able to follow commands such as "I am going on a vacation, pack my suitcase with all I need" without giving a detailed list.
- gjvc 2y agoand bard/gemini and chatgpt consistently given look-good-but-broken examples when asked for help with code. the bubble on this is going to make the .com crash look like peanuts.
- KingOfCoders 2y agoFrom my experience it depends on the length of the task. For ~50 LOC examples ChatGPT can consistently modify the code to add some new parameter or change some behaviour etc. For using new external APIs it hallucinates often - that said, all of my changes to my static Hugo websites: new shortcodes, modifying short codes like "change the list of random articles to only include articles that have the same 'type'" works excellent - are done by ChatGPT without problems. > .com crash look like peanuts. I think what people get wrong about the .com crash: It wasn't a technology crash but a crash of overvalued companies and the sudden fear of VCs. Internet usage and new applications just grew and grew. There was no internet technology crash - and many successful companies like Amazon and eBay just kept working - the pet.com's of the world died (and sadly my Wiki/Blog/Onthology startup died too)
- 2y ago
- portaouflop 2y agoLet’s call it machine learning, the AI term is just so far from what it actually is
- openmajestic 2y agoI like using AI or generative AI. Each term we use signifies the era of the technology. When I was starting, expert systems were the old thing, AI was a taboo phrase that you avoided at all costs if you wanted funding, and ML was the term of the day. Then it was the deep learning era. And now we are in the generative AI era - and also an AI spring which makes the term AI appropriate (while the spring lasts).
- grantcas 2y ago[dead]
- bubblyworld 2y agoHe's talking about control theory, and other kinds of optimisation systems too. I think AI is a fine blanket term for all of that stuff.
- DonHopkins 2y agoRodney Brooks is the Godfather of Out of Control Theory. FAST, CHEAP AND OUT OF CONTROL: A ROBOT INVASION OF THE SOLAR SYSTEM: https://people.csail.mit.edu/brooks/papers/fast-cheap.pdf https://people.csail.mit.edu/brooks/papers/fast-cheap.pdf
- bubblyworld 2y ago"Out-of-Control Theory" is a great name, love it =) thanks for the link, although I guess the idea never really took off.
- DonHopkins 2y agoIt certainly did take off, it's called "Subsumption Architecture", and Rodney Brooks started iRobot, who created the Roomba, which is based on those ideas. https://en.wikipedia.org/wiki/Subsumption_architecture https://en.wikipedia.org/wiki/Subsumption_architecture Subsumption architecture is a reactive robotic architecture heavily associated with behavior-based robotics which was very popular in the 1980s and 90s. The term was introduced by Rodney Brooks and colleagues in 1986.[1][2][3] Subsumption has been widely influential in autonomous robotics and elsewhere in real-time AI. https://en.wikipedia.org/wiki/IRobot https://en.wikipedia.org/wiki/IRobot iRobot Corporation is an American technology company that designs and builds consumer robots. It was founded in 1990 by three members of MIT's Artificial Intelligence Lab, who designed robots for space exploration and military defense.[2] The company's products include a range of autonomous home vacuum cleaners (Roomba), floor moppers (Braava), and other autonomous cleaning devices.[3]
- none_to_remain 2y ago> Brooks explains that this could eventually lead to robots with useful language interfaces for people in care situations. I've been thinking, in Star Trek terms, what if it's not Lt. Cdr. Data, but just the Ship's Computer?
- KingOfCoders 2y agoI like Data, but I never understood the concept. What does he really ad above the ships computer? Why have the ship computer walk around (I know feelings and stuff). In Ian Banks universe AIs also have avatars, but for the sole benefit of humans, they like to interact with avatars more than with a voice in their head.
- none_to_remain 2y agoData & the Ship's Computer are separate entities running on different substrates. I think that Data is an example of "AGI", while the Ship's Computer is excellent at responding to natural language queries.
- chumpro 2y agoAI is a tool, not a thing. With better integration into the traditional programming environment it will become yet another programming tool. This is basically like when programs went from being text based to UI based. Future software will have AI, LLMs, as a component/interface. The "LLM is the program" is not adequate, reliable, scalable.
- DonHopkins 2y agoOr Bomb 20. https://www.youtube.com/watch?v=h73PsFKtIck https://www.youtube.com/watch?v=h73PsFKtIck
- Animats 2y agoThat makes sense from Brooks' perspective. He's done his best work when he didn't try to overreach. The six-legged insect thing was great, but very dumb. Cog was supposed to reach human-level AI and was an embarrassing dud. The Roomba was simple, dumb, and useful. The military iRobot machines were good little remote-controlled tanks. The Rethink Robotics machines were supposed to be intelligent and learn manipulation tasks by imitation. They were not too useful and far too expensive. His new mobile carts are just light-duty AGVs, and compete in an established market.
- hdhshdhshdjd 2y ago[flagged]
- KingOfCoders 2y agoThe Roomba always felt like these coding exercises of a ball bouncing off the screen limits: IF X > 600 || X < 1 THEN VX = -VX + RAND IF Y > 600 || Y < 1 THEN VY = -VY + RAND
- Animats 2y agoClose. Brooks once described the Roomba algorithm as something like this: 1. Go in a random direction in a straight line for a while. 2. Then spiral outwards until hit something. 3. Try turning some random angle. If repeatedly hitting a wall, go into wall following mode for a while. Otherwise, go back to step 1. If you run this long enough to travel over 2x the actual floor area, the odds of achieving near full coverage are pretty good. Who needs navigation?
- roenxi 2y ago> He uses the iPod as an example. For a few iterations, it did in fact double in storage size from 10 all the way to 160GB. If it had continued on that trajectory, he figured out we would have an iPod with 160TB of storage by 2017, but of course we didn’t. I think Brooks' opinions will age poorly, but if anyone doesn't already know all the arguments for that they aren't interested in learning them now. This quote seems more interesting to me. Didn't the iPod switch from HDD to SSD at some point, and they focused on shrinking them rather than upping storage size? I think the quality of iPods have been growing exponentially, we've just seen some tech upgrades on other axises that Apple thinks are more important. AFAIK, looking at Wikipedia, they're discontinuing iPods in favour of iPhones where we can get a 1TB model and the disk size trend is still exponential. The original criticism of the iPod was that it had less disk space than its competitors and it turned out to be because consumers were paying for other things. Overall I don't think this is a fair argument against exponential growth.
- ozgrakkurt 2y agoHow can it exponentially grow ever? It is a small device that plays music
- pyrale 2y ago> Overall I don't think this is a fair argument against exponential growth. Do we still need to make a fair claim against unrestricted exponential growth in 2024? Exponential growth claims have been made countless times in the past, and never delivered. Studies like the Limits to Growth report (1972) have shown the impossibility of unrestricted growth, and the underlying science can be used in other domains to show the same. There is no question that exponential growth doesn't exist, the only interesting question is how to locate the inflexion point. Apparently the only limitless resource is gullible people.
- Eisenstein 2y agoMoore's law?
- 2y ago
- globalnode 2y agoi dont know much about machine learning but what i think i know is that its getting an outcome based on averages of witnessed data/events. so how's it going to come up with anything novel? or outside of normal?
- randcraw 2y agoIt can't. Without the ability to propose a hypothesis and then experimentally test it in the physical real world, no ML technique or app can add new information to the world. The only form of creativity possible using AI (as it exists today) is to recombine existing information in a new way -- as a musical composer or jazz artist creates a variation on an theme that already exists. But that can't be compared to devising something new that we would call truly creative and original, especially novel work that advances the frontier of our understanding of the world, like scientific discovery.
- raincole 2y ago> i dont know much about machine learning but what i think i know is that its getting an outcome based on averages of witnessed data/events "Extrapolation" is the word you're looking for, for a superficial understanding of machine learning. "Average" isn't even remotely close.
- ben_w 2y agoThat's not what ML is. You have some input, which may include labels or not. If it does have labels, ML is the automatic creation of a function that maps the examples to the labels, and the function may be arbitrarily complex. When the function is complex enough to model the world that created the examples, it's also capable of modelling any other input; this is why LLMs can translate between languages without needing examples of the specific to-from language pair in the training set. The data may also be synthetic based on the rules of the world; this is how AlphaZero beats the best Go and chess players without any examples from human play.
- richrichie 2y agoML is (smooth) surface fitting. That's mostly it. But that is not undermining it in any way. Approximation theory and statistical learning have long history, full of beautiful results. The kitchen sinks that we can throw at ML are incredibly powerful these days. So, we can quickly iterate through different neural net architecture configurations, check accuracy on a few standard datasets and report whatever configuration that does better on Archiv. Some might call it 'p-hacking'.
- fxtentacle 2y agoTo me, this reads like a very reasonable take. He suggests to limit the scope of the AI problem, add manual overrides in case there are unexpected situations, and he (rightly, in my opinion) predicts that the business case for exponentially scaling LLM models isn't there. With that context, I like his iPod example. Apple probably could have made a 3TB iPod to stick to Moore's law for another few years, but after they reached 160GB of music storage there was no usecase where adding more would deliver more benefits than the added costs.
- raincole 2y ago> Apple probably could have made a 3TB iPod It's a very weird comparison, as putting more music tracks to your iPod doesn't make them sound better, while giving a LLM more parameters/computing power make it smarter. Honestly it sounds like a typical "I've drawn my conclusion, and now I only need an analogy that remotely supports my conclusion" way of thinking.
- derefr 2y agoNo, it makes sense: he's coming at it from the perspective of knowing exactly what task you want to accomplish (something like "fixing the grammar in this document.") In such cases, a model only has to be sufficiently smart to work for 99.9999% of inputs — at which point you cross a threshold where adding more intelligence is just making the thing bulkier to download and process, to no end for your particular use-case. In fact, you would then tend to go the other way — once you get the ML model to "solve the problem", you want to then find the smallest and most efficient such model that solves the problem. I.e. the model that is "as stupid as possible", while still being very good at this one thing.
- greybox 2y agoIf you have no conception of mathematics, do you think you'd get better at solving mathematics problems based on looking at more examples of people who may or may not be solving them correctly?
- 2y ago
- aetherson 2y agoWe'll see GPT-5 in a few months and that will be vastly more useful information to update your sense of whether the current approach will continue to work than anyone's speculation today.
- christianqchung 2y agoIn a few months, or in 18 months? Mira Murati said this month that the next "PhD level intelligence" models will be released in a year or a year and a half. Everything points to GPT-5 not happening this year, especially given that they've only started the training officially last month.
- wrasee 2y agoRight. Given we have so few data points at least GPT 5 will offer a completely new one. That will actually be new information.
- locallost 2y agoAfter using Copilot that is pretty bad at guessing what I exactly want to do, but still occasionally right on the money and often pretty close: AI is not really AI and it won't kill us all, but the realization is that a lot of work is just repetitive and really not that clever at all. If I think about all the work I did in my life it follows the same pattern: a new way of doing things comes along, then you start figuring out how to do it and how to use it, and once you're there you rinse and repeat. The real value in the work will be increasingly in why is it useful for people using it, although it probably was like this always, the geeks just didn't pay attention to it. Sorry for not commenting on the article directly.
- visarga 2y ago> a new way of doing things comes along, then you start figuring out how to do it and how to use it, and once you're there you rinse and repeat This happens a billion times a month in chatGPT rooms. User comes with a task, maybe gives some references and guidance. The model responds. User gives more guidance. And this iterates for a while. The LLM gets tons of interactive sessions, it can learn how to rank the useful answers higher. This creates a data flywheel where people generate experience and LLMs learn and iteratively improve. LLMs have the tendency to make people bring the world to them, they interact with the real world through us.
- ilaksh 2y agoHave you ever used gpt-4o, voice mode or Claude 3.5 Sonnet, or any other leading models, or are you really basing your entire assessment on Copilot? OoenAI hasn't even released their best model/capabilities to the public yet. Their text to image capabilities they show in their gpt-4o page are mine-blowing. The (unreleased) voice mode is a huge step up in simulating a person and often quite convincing.
- lostmsu 2y agoCopilot can not read your mind: that is an impressive argument against AI!
- locallost 2y ago
- qeternity 2y agoThe iPod analogy is a poor one. Instead of 160TB music players, we got general computers (iPhone) with effectively unlimited storage (wireless Internet). I don’t need to store all my music on my device. I can have it beamed directly to my ears on-demand.
- danparsonson 2y agoThat's the point though, an iPhone is not just a bigger iPod - scaling by itself isn't enough.
- qeternity 2y agoNo, it's not. Scaling did work. The internet gives us (effectively) unlimited storage. We just scaled in a slightly different way.
- caddemon 2y agoThe music part is just scaling in a different way, but that's not the reason the iPhone is so successful. The leap from iPod to iPhone was definitely not just scaling.
- deleted 2y ago[deleted]
- pikseladam 2y agothe thing is, you can't know if i'm an ai generated comment or not. this is the thing.
- card_zero 2y agoLooks like you were trained on data without any capital letters.
- helf 2y ago[dead]
- grantcas 2y ago[dead]
- deleted 2y ago[deleted]