4 ms·
AI is a 'Glorified Tape Recorder,' Says Theoretical Physicist Michio Kaku (2023)
- mnky9800n 3y agoI don't understand why people care what he has to say on any of the topics he gets asked to give an opinion on.
- ycombinete 3y agoThis type of thing always reminds me of Dave Chappelle’s bit on Ja Rule being asked for his opinion on September 11th: https://youtu.be/Mo-ddYhXAZc?si=rKYGUpZJgb0RU7Qg https://youtu.be/Mo-ddYhXAZc?si=rKYGUpZJgb0RU7Qg
- willvarfar 3y agoSeems reasonable to me. Right now, LLMs are basically regurgitating an average of the whole internet. Dog-level AI indeed. There might be a breakthrough in grokking and building abstractions https://pair.withgoogle.com/explorables/grokking/ https://pair.withgoogle.com/explorables/grokking/ and at that point the scary thing is that a big tech billionaire or state government has no incentive to share that with humanity, but rather to use selfishly. That's the scary inflection point on the horizon.
- laichzeit0 3y agoWho cares. It's useful as hell. Here's one of my questions yesterday: https://chat.openai.com/share/500a4377-7cf5-47b3-b833-74b85def9132 https://chat.openai.com/share/500a4377-7cf5-47b3-b833-74b85d.... You know how long it would take me to Google this crap and piece together a coherent answer after going through a rabbit hole of JSTOR reviews, math stackexchange and Reddits? I don't have the time for that, and if that is what regurgitating an average of the whole internet means, I am very glad someone decided to build something like that.
- candiodari 3y agocough https://www.google.com/search?client=firefox-b-d&q=What+are+the+main+editions+and+what+are+the+differences+between+them+for+Courant%27s++Calculus+and+Analysis+books%3F+site%3Areddit.com https://www.google.com/search?client=firefox-b-d&q=What+are+... have you heard of "site:reddit.com"? I will say that "site:reddit.com" is merely a poor man's way of telling Google "don't give me low quality machine generated results". Which, ironically, is exactly what you want ... from an AI! Funny ... it's like a text based version of the plot of terminator: only machines ... can protect you from the machines! I do think you're right btw, but for me the best applications of AI are, well, applied. As in "write tests for code X", "use library Y to ...". The code is definitely not useful as-is, far from it. But ...
- laichzeit0 3y agoYes that's kind of my point, I don't _want_ to go and read through the pages returned by a search engine. I have a clear question and I want an answer. If I want to dig more, I would. That's exactly what these LLMs are providing, it's extremely useful.
- leephillips 3y agoSeems to work even better without the `site:` qualifier.
- anentropic 3y agoDogs can't do that
- Angostura 3y agoAnd a computer is a glorified abacus. Given the possible range of complexity that hides inside the word 'glorified' I'm not sure it's particularly helpful
- richrichie 3y agoA lot of people dismiss LLMs based on how ridiculously simple next token prediction is. Human nerve cells look ridiculously simple relative to what a clump of them can do. So does a transistor that CPUs are built out of.
- nicklecompte 3y ago[deleted]
- catchnear4321 3y agothe claim was not made that something is simple. (other than llm output.) “look.” which can be done with an untrained eye. A hand looks simple to a child. to a doctor? orthopedic surgeon? worse, to an untrained eye, your response looks like it is from an llm. it would explain missing the nuance. not the only explanation by far, but when combined with talk of genetic effects in the footnote…
- nicklecompte 3y agoI deleted my comment, it was a mistake to get involved in this conversation.
- catchnear4321 3y agothat wasn’t the mistake.
- deleted 3y ago[deleted]
- visarga 3y agoThey are complicated because they got to do something much harder than neural nets - they have to build themselves starting from a single cell. When a neural net will be able to secrete GPUs to enlarge itself like the brain, then it will do the same thing with brains. But then it would have to carry extra apparatus. A neural net doesn't need to operate for 80-90 years without servicing the hardware, brain builds redundancy from the start to compensate. And brains keep an energy budget of just a few watts, not kilowatts. Out of all that complex biology in the brain maybe just a small part of it is contributing to intelligent behavior. Most of it is for support or redundancy. So I don't care you can equal a neuron with a 3 layer MLP with 1000 neurons or more. A model that fits on a DVD can speak fluent language, write code, and solve tasks - that is the useful capacity we are looking for.
- nicklecompte 3y agoI am quite critical of LLMs but I really don't see the point of asking Michio Kaku what he thinks, other than cynically leveraging his status as a physicist so he can be a "thoughtfluencer" in areas he probably doesn't know very much about. Becoming a celebrity seems to be the worst thing that can happen to a thinker.
- itsoktocry 3y ago>other than cynically leveraging his status as a physicist so he can be a "thoughtfluencer" So should we only be listening to the people with a financial stake in the outcomes, in either direction? Not saying he's correct, or even that I agree. But it seems like we should listen to random, smart people.
- deleted 3y ago[deleted]
- pants2 3y agoI'd listen to Kaku on this if it were clear he had actually spent significant time using, developing, and understanding LLMs, but it's apparent that he hasn't and is just parroting other takes he's seen online ;)
- deleted 3y ago[deleted]
- vidarh 3y agoThat he's calling it a glorified tape recorder suggests he'd have been smarter if he'd answer he doesn't know the field and so doesn't have anything to say about it, and is a strong argument for why listening to random smart people is not necessarily going to be very useful.
- bookofjoe 3y agoBut then he'd never have made it to Hacker News.
- 3y ago
- causi 3y agoNot that it's wrong, but why is the opinion of a string theorist on LLMs significant?
- deleted 3y ago[deleted]
- krapp 3y agoEveryone's having a field day dunking on Michio Kaku for talking out of his field but let's be realistic - everyone talks out of their ass here, all the time. This community is particularly well known for its strain of aggressive ignorance on all sorts of subjects, with physics threads especially being peppered with crankery. If we limited conversation on HN only to people with relevant, real world experience in the subject being discussed, this place would turn into a mausoleum. Kaku claiming AI is a glorified tape recorder is no more or less insightful than the countless people here parroting "humans also do x" on the other side. It's an emotional argument. Maybe instead of attacking the person, it would be better to attack their argument. As of my writing this, there are 36 comments and not one seems willing or capable of making a coherent, technical counterargument. It's just "lol who's this nerd?"
- causi 3y agoHe's not wrong, he's just saying stuff we're already familiar with and we're annoyed someone who's well known as being a dick in person is getting more attention.
- eurekin 3y agoI'd really love to see his more recent real physics publications. arXiv lists the latest as 24 year old: https://arxiv.org/search/?query=Michio+Kaku&searchtype=all&source=header https://arxiv.org/search/?query=Michio+Kaku&searchtype=all&s... . Didn't he pivot around 2000's to a public speaker figure?
- mynegation 3y agoGoogle is a glorified library. Excavator is a glorified spade. See, I don’t have to be Michio Kaku to do that. I wonder if sometimes people like Kaku make these outlandish statements for publicity.
- Brian_K_White 3y agoActually those all work fine and don't invalidate his point. No one thinks an excavator drives itself, not even the highly autonomous farm equipment. That was the point, was to say that llms are merely equipment.
- 0thgen 3y agoInterestingly though, he seems to use AI and LLMs interchangeably. AI risk != LLMs; the latter just happened to be so impressive that they shocked us into worrying more about the former. Which is arguably a good thing: humanity beginning preparations for a dangerous tool before the actual dangerous part has even happened
- Brian_K_White 3y agoI do agree with that. It's kind of a facet of the same premis. If a thing is mere equipment, then everyone knows it needs an operator. You don't start the car up and turn it loose to run down the road by itself. A thing doesn't have to have agency to be dangerous. Except we are starting to do exactly that because too many people are not realizing that neither llms nor ai are actually ai with understanding and agency. Or really, they do have agency because we're giving them agency, but we're giving agency to things that don't have understanding and that's the problem.
- bookofjoe 3y agoHacker News is a glorified virtual Colosseum whose emperor is dang
- FrustratedMonky 3y agoI just asked my GPT friend about this. He was little salty about always being picked on as not intelligent. "If AI is a glorified tape recorder, then humans are quirky old computers, running on organic software that requires coffee to boot up, prone to emotional overheating, and occasionally needing to be put into sleep mode to prevent system crashes."
- candiodari 3y agoSame can be said of my manager.
- iamnotsure 3y agoInternet is a glorified telephone.
- kwertyoowiyop 3y agoI am a glorified amoeba.
- deleted 3y ago[deleted]
- Brian_K_White 3y ago"Why do we care..." It's not about him especially. What are all your possible sources of other opinions to consider? * Informed, or at least intelligent, biased stake holders. (People with money or status or even merely true simple academic interest in it) * Uninformed or unintelligent biased stake holders. (Maybe politicians or religious) * Informed or at least intelligent non stake holders. (Kaku) * Uninformed or unintelligent non stake holders. (Me) All the other 3 groups are blasting out their opinions like they actually matter at all times, and that matters because through one mechanism or another, be it voting or market, we make policy by simple popularity. I would say that is why the opinion of anyone in that group matters. Not because it's him by name, but just anyone not in the other 3 groups.
- freitzkriesler2 3y agoI always said AI was the equivalent of algorithmic slight of hand and I still feel that way with these LLM models out there.
- tyronehed 3y ago[dead]
- stormfather 3y agoPeople tend to like thinking their particular area of expertise is the acme of human pursuit, and everything else gets more attention than it warrants.
- Havoc 3y agoThat frankly sounds like someone that has never used chatgpt for anything beyond “write me a poem” and read a lot of news about artist work being stolen. A valid point certainly but missing a key angle. The fact that the models are capable following basic data processing tasks. Ie here is a table I need you to do xyz with it tells me this “they’re just parrots” view fundamentally doesn’t capture where the utility and usefulness lies.
- glimshe 3y agoMichio Kaku likes to speculate a whole lot, and is no stranger to pushing pseudoscience. I don't mean to say this as an ad hominem attack, maybe he's right in this instance, but not caring about his opinion in an area outside his expertise is a rational course of action given the limited number of hours in our lives.
- throwawa14223 3y agoTape recorders don’t get randomly added to my start menu and ship my data back to Microsoft.
- beej71 3y ago"Yes! Yes, it is!" --Alan Turing