4 ms·

Programming bubble will pop. Automated Machine learning is taking over. Even at google, Jeff Dean has recently stated that his Perceptual AI project is aimed at

Programming bubble will pop. Automated Machine learning is taking over. Even at google, Jeff Dean has recently stated that his Perceptual AI project is aimed at reducing feature engineering in their machine learning projects. In plain terms this means eliminating the need for programming in their search engines and other machine learning focused projects like google now and google goggles (the mobile app, not google glass). The only programmers left will be to manage cloud computing infrastructure and front end programmers. As things like siri and google now take off, front end programmers will also be in less demand. Microsoft, Apple, and Amazon are also increasingly focusing on machine learning. Automated analysis of text will take over the role of sql databases as demonstrated in IBM watson. In manufacturing, the role of programming also diminishing as vision guided robots like Baxter by Rodney Brooks's team take off. All this is a good thing though, programming is slow and data is agile, as talked about by Peter Norvig in his startup school 2008 speech http://www.youtube.com/watch?v=LNjJTgXujno http://www.youtube.com/watch?v=LNjJTgXujno Startups should aim at doing as little programming as possible and leaving it to data crunching.

seiji 14y ago
The current incarnation of machine learning is nothing more than an ultra high dimensional two year old. "Here's a new item. Which pool of millions of items is this new thing like?" "Is the red square more like these other red squares or the green triangles?" You can get pretty far extracting the math behind the meaning, but lack of meaning is still deathly apparent. We should fix that sometime.
- paulgb 14y ago
  Yeah, but the two-year-old scales to huge datasets and doesn't cry a lot.
- marshallp 14y ago
  I think most people are interested in practically solving problems. If the black box can solve it, there's no reason to care about "meaning". Once the machines have taken over all jobs, you can sit around and understand the meaning of things to your satisfaction at your own leisure surrounded by the luxury the machines have created for you.
  - seiji 14y ago
    Imagine how many more problems we could solve with meaning. Every secretary in the world could be fired. Software could actually know you. It would be a huge psychological problem for people. You think MMOs kill brains in south east asia now? Wait until software acts like a boyfriend. Every site (read: website/app/software) could be unique, well designed, and work cross platform by telling the system what you want (remember: in this delusional scenario the system understands meaning to avoid the unintentional vengeful djinn problem). You think multivariate testing is omgballz amazing? Imagine if ad networks share a sophisticated personality model (instead of: likes cats, doesn't like monster trucks) of you. Every site you visit could be rearranged to appeal to your individual design sense, buying patterns, and social expectations. A/B testing basically tries to suss out your average user so you can appeal to them. You leave your non-average users in the dirt by optimizing for the common moron. It's possible and I think the incumbent giants will miss it whenever it happens (5-10-50 years out).
disgruntledphd2 14y ago
Citations needed. You seem to be commenting like this on many topics (wherever its tangentially relevant). I would really like to know why you think this will happen, what you think are the most promising machine learning methods for achieving it, and who you think is going to program these machine learning methods. I love machine learning don't get me wrong, and I'd like to see Skynet (hopefully friendly) in my lifetime, but the current state of the field does not reassure me on this matter.
- seiji 14y ago
  It's as easy to buy into the church of the singularity as it is to buy into the "We'll have a million customers and $10MM/month in subscriptions within a week of launching" belief after releasing your four-years-in-stealth-mode-with-no-customer-feedback startup. Beliefs based on other beliefs generate even further out beliefs unhinged from reality. It's not that they aren't true -- they just aren't true yet, and imagination doesn't count as ground truth (because magic doesn't exist).
  - marshallp 14y ago
    This is not about the singularity. This is about data vs programming. And your attacks on the singularity are misguided. You think singularity people are retarded and your anti-singularity possie are holier, yet you don't have a coherent anti-singularity argument. Any fool can tear down a barn, but it takes a carpenter to build one.
    - seiji 14y ago
      Oh, I certainly don't have an anti argument. We'll end up destroying ourselves, be obliterated by cosmic events, or eventually run civilization from computer simulations. People have just been saying "real soon now" for 60 years. Obviously we are more "real soon now" than back then, but it's still unclear how soon we can be. My favorite knock down is the "when computers get fast enough, we'll magically have AGI/hard AI." If that were the case, we could have really really slow versions now. Theoretical vs. practical architectures matter. Nobody can imagine an iPad's software ecosystem if your model is vacuum tubes and single tape turing machines. But when you hit CPUs, shrinking processes, and GPUs with 6 teraflops on a card, you see how impossible your goals were with a 0.2 MHz room-sized computer with 500k of memory. If you immediately know the candle light is fire, then the meal was cooked a long time ago.
tabdon 14y ago
It just makes sense that eventually we will create systems that do the work that is currently manual. That has been human history (printing press, manufacturing, etc). The good thing is that we are crafty buggers and will always find a new job to do even when we've just replaced the manual labor that was oh so painful to perform before.
wisty 14y ago
In 1954: Programming bubble will pop. Compilers are taking over. Soon, anyone will be able to control computers using simple English commands.
- marshallp 14y ago
  That kind of happened if you frame it in their era - HTML, CSS, PHP, SQL.

seiji 14y ago

The current incarnation of machine learning is nothing more than an ultra high dimensional two year old. "Here's a new item. Which pool of millions of items is this new thing like?" "Is the red square more like these other red squares or the green triangles?" You can get pretty far extracting the math behind the meaning, but lack of meaning is still deathly apparent. We should fix that sometime.

paulgb 14y ago
Yeah, but the two-year-old scales to huge datasets and doesn't cry a lot.
marshallp 14y ago
I think most people are interested in practically solving problems. If the black box can solve it, there's no reason to care about "meaning". Once the machines have taken over all jobs, you can sit around and understand the meaning of things to your satisfaction at your own leisure surrounded by the luxury the machines have created for you.
- seiji 14y ago
  Imagine how many more problems we could solve with meaning. Every secretary in the world could be fired. Software could actually know you. It would be a huge psychological problem for people. You think MMOs kill brains in south east asia now? Wait until software acts like a boyfriend. Every site (read: website/app/software) could be unique, well designed, and work cross platform by telling the system what you want (remember: in this delusional scenario the system understands meaning to avoid the unintentional vengeful djinn problem). You think multivariate testing is omgballz amazing? Imagine if ad networks share a sophisticated personality model (instead of: likes cats, doesn't like monster trucks) of you. Every site you visit could be rearranged to appeal to your individual design sense, buying patterns, and social expectations. A/B testing basically tries to suss out your average user so you can appeal to them. You leave your non-average users in the dirt by optimizing for the common moron. It's possible and I think the incumbent giants will miss it whenever it happens (5-10-50 years out).

disgruntledphd2 14y ago

Citations needed. You seem to be commenting like this on many topics (wherever its tangentially relevant). I would really like to know why you think this will happen, what you think are the most promising machine learning methods for achieving it, and who you think is going to program these machine learning methods. I love machine learning don't get me wrong, and I'd like to see Skynet (hopefully friendly) in my lifetime, but the current state of the field does not reassure me on this matter.

seiji 14y ago
It's as easy to buy into the church of the singularity as it is to buy into the "We'll have a million customers and $10MM/month in subscriptions within a week of launching" belief after releasing your four-years-in-stealth-mode-with-no-customer-feedback startup. Beliefs based on other beliefs generate even further out beliefs unhinged from reality. It's not that they aren't true -- they just aren't true yet, and imagination doesn't count as ground truth (because magic doesn't exist).
- marshallp 14y ago
  This is not about the singularity. This is about data vs programming. And your attacks on the singularity are misguided. You think singularity people are retarded and your anti-singularity possie are holier, yet you don't have a coherent anti-singularity argument. Any fool can tear down a barn, but it takes a carpenter to build one.
  - seiji 14y ago
    Oh, I certainly don't have an anti argument. We'll end up destroying ourselves, be obliterated by cosmic events, or eventually run civilization from computer simulations. People have just been saying "real soon now" for 60 years. Obviously we are more "real soon now" than back then, but it's still unclear how soon we can be. My favorite knock down is the "when computers get fast enough, we'll magically have AGI/hard AI." If that were the case, we could have really really slow versions now. Theoretical vs. practical architectures matter. Nobody can imagine an iPad's software ecosystem if your model is vacuum tubes and single tape turing machines. But when you hit CPUs, shrinking processes, and GPUs with 6 teraflops on a card, you see how impossible your goals were with a 0.2 MHz room-sized computer with 500k of memory. If you immediately know the candle light is fire, then the meal was cooked a long time ago.

tabdon 14y ago

It just makes sense that eventually we will create systems that do the work that is currently manual. That has been human history (printing press, manufacturing, etc). The good thing is that we are crafty buggers and will always find a new job to do even when we've just replaced the manual labor that was oh so painful to perform before.

wisty 14y ago

In 1954: Programming bubble will pop. Compilers are taking over. Soon, anyone will be able to control computers using simple English commands.

marshallp 14y ago
That kind of happened if you frame it in their era - HTML, CSS, PHP, SQL.