4 ms·
Out of your list, translating language and solving protein folding are the only 2 that are likely to have any kind of major impact on the world in the somewhat
by tsimionescu 6y ago
Out of your list, translating language and solving protein folding are the only 2 that are likely to have any kind of major impact on the world in the somewhat near future, in my opinion. Image recognition may be a distant third, as it could prove very useful as a tool in many domains that have lots of visual data to sift through.
Voice recognition is neat, and it is extremely useful in certain niches, but it is generally far inferior to mouse+keyboard or touch or dedicated buttons in all cases where those are practical. It is almost unusable in public spaces. Text-to-speech is mostly in the same boat - extremely useful in some niches, not a game-changer in any way I expect.
Text generation is only "realistic" in shape, but for now remains a novelty. Picture generation is the same. They are at best at the level where it already costs pennies to obtain similar texts through human labor. Having conversations in a meaningful way is even farther.
Playing Go better than humans is a fun gimmick - an awesome achievement in some sense, but with 0 practical applications outside of Go.
Overall, there has been good progress in AI/ML, but I don't expect we'll see any major changes too soon from this. Especially since the idea of actually seeing commercially available self-driving cars has been pushed back a decade or three compared to the initial optimism.
I'd also add that most of the progress in ML/AI in the last few years has essentially been of a technological/engineering kind. There haven't really been that many deep scientific insights, we don't necessarily understand any of these problem spaces better. We've just been able to match certain neural net architectures with certain problem spaces, and massively advanced in realistically-available computing power to actually train these nets on enough data.
But we haven't gotten any new insights into stuff like language from GPT-3, for example. We haven't even gotten any new insights into Go from AlphaGo!
- ummonk 6y agoComputer vision is used for many driver assistance technologies, which are a big deal for ease of life.
- amelius 6y agoPeople obsess too much over minor conveniences. I don't care about driving. It still takes the same amount of time. What I care more about is cooking. I'd rather have that one solved, as it would actually save me time. (No, I'm not looking for restaurants, meal delivery services or microwave meals).
- a_t48 6y agoDriving assistance is about safety, not about convenience.
- matkoniecz 6y ago> I don't care about driving. It still takes the same amount of time. If it would be automated, the you would be able to use this time for something else rather than driving.
- amelius 6y agoIn theory yes, in practice mostly no.
- what_ever 6y agoCan you elaborate why mostly no in practice?
- amelius 6y agoYou're sitting in a confined space with semi-random forces acting on you.
- matkoniecz 6y agoI am succesfull with productive and semi-productive activities in a buses (at least when travel time is below 8 hours).
- ummonk 6y agoI've found traffic aware cruise control greatly reduces driver fatigue as you don't have to constantly manage your speed. This improves both safety (you stay more alert and can spend more of your effort scanning and maintaining situational awareness) and means you're less tired to engage in other activities when not driving.
- tsimionescu 6y agoThey are, currently at least, a small improvement for a small part of many people's lives. They probably have a measurable impact on the world, but not anything that could be called world changing.
- ma2rten 6y agoI'm sure that most people didn't expect major changes from pcs, the internet and smartphones before mass adoption. As this is a community tied to a startup incubator, I would encourage everyone here to keep an open mind.
- solidasparagus 6y agoYou’re statement about us not learning anything about Go from AI agents is just false. Also we have seen a rapid improvement in the accuracy/speed curve, most notably with NAS. It hasn’t just been increased computational power. AFAIK the use of learned embedding in the biomedical space has improved our understanding of the science/our ability to find high value experiments to run. I think the coherency of GPT-3 and the RL learned tool use work both raise extremely interesting questions about the nature of language and high-level intelligence. Questions that we couldn’t meaningfully ask before that evidence. I also think you’re being shortsighted about the possibilities that are opened up as we enable computers to understand and interact with the real world in more way. Increased visual and audio understanding will lead to more passive computing and that has all sorts of fascinating implications. I don’t know what insights you’re looking for. We’re seeing AI reveal fascinating phenomena in language, vision and general purpose learning. Scientific advancement is often about asking the right questions and unexplainable phenomena is the driver of those questions. Much like some phenomena (I want to say something to do spectral) were unanswered questions that developed into the field of quantum mechanics, what we’re seeing in AI is currently unexplainable phenomena. Are you in the field? You’ve focused on the things that made global headlines, but I feel like there’s so much more.
- tsimionescu 6y ago> You’re statement about us not learning anything about Go from AI agents is just false. Also we have seen a rapid improvement in the accuracy/speed curve, most notably with NAS. It hasn’t just been increased computational power. We've learned how to play better Go, but not anything like a new (mathematical) theory of Go, as far as I have read. And I didn't claim it's just about computing speed improvements, I also noted that we have started the right formulas to fit specific NN architectures with specific kinds of problems. > AFAIK the use of learned embedding in the biomedical space has improved our understanding of the science/our ability to find high value experiments to run. Awesome, this is one thing I hadn't heard about. > I think the coherency of GPT-3 and the RL learned tool use work both raise extremely interesting questions about the nature of language and high-level intelligence. Questions that we couldn’t meaningfully ask before that evidence. They do raise interesting questions in a philosophical sense, but those questions do not seem to have piqued the interest of the AI community. The GPT-3 paper covers some interesting facts about GPT-3's ability to do arithmetic, but only briefly, and that's about it. They explicitly attribute GPT-3's impressive gains over GPT-2 entirely to the hugely increased parameter space, and mention that they believe that increasing the parameter space again by an order of magnitude will increase the realness even more - that's the extent of their analysis about its implications on language that I've seen (perhaps I missed something?). I haven't even seen a real discussion about how different GPT-3's output is compared to it's training inputs. Given the gigantic corpus that they have used to train it, I would expect to see more scrutiny in this area. For the arithmetic operations, they mention some attempts they made to check that it wasn't reproducing a calculation it had explicitly seen, but they are not confident that they were enough. More importantly, it is obvious that, even if GPT-{X} will be a complete model of human language, it will (1) have nothing to do with how humans acquired language, either individually or evolutionarily; and (2) that it won't be able to produce meaning that is not captured in its corpus, as it will have no notion of the human world and its reality; it might be able to produce commentary on current events that sounds plausible, but any relation between its commentary and reality will be either entirely captured in the training corpus, in the priming text, or entirely accidental. > I also think you’re being shortsighted about the possibilities that are opened up as we enable computers to understand and interact with the real world in more way. Increased visual and audio understanding will lead to more passive computing and that has all sorts of fascinating implications. Of course that's a strong possibility - the future is usually surprising. However, the only applications actually visible on the horizon are bone-chilling: mass surveillance that even Orwell didn't dream of, increasingly being actively used by more and more authoritarian regimes, from China to the US to Europe. It may well soon turn out that the AI fearmongers were right to fear AI, though of course not in the puerile fantasy of the paper-clip optimizer. > We’re seeing AI reveal fascinating phenomena in language, vision and general purpose learning. I have seen little to no coverage of such fascinating phenomena, and entirely too much coverage about precision rates, eerily human-like language generation, and a belief that bigger models and more data are the only way forward. Everything I have seen has been AI research not only not asking questions about such phenomena, but instead shutting down any questions, claiming that the million-parameter models that they produce on terrabytes of training ARE the answers [0]. > Are you in the field? You’ve focused on the things that made global headlines, but I feel like there’s so much more. I am not in the field of AI/ML, no (the closest I got was doing my bachelor's thesis on an RL approach). The things I focused on were the advances highlighted by the post I replied to. I have no doubts that there are many advances in the techniques of AI that would completely fly over my head, and I am certain that there are successful applications of AI on hard problems that I never even heard about. AI is certainly a useful technique in many fields, though often over-hyped as well. Still, judging by what is commonly highlighted as the major achievements of the field, my prediction is still that it's positive impact on the world will continue to be limitted for the next 1-2 decades; its negative impact through enabling mass surveillance may well be far greater. [0] http://norvig.com/chomsky.html http://norvig.com/chomsky.html