6 ms·
>> The more important question might be: can we ever have a fair fight between humans and machines? Fair or not fair, there is no API to the real world. If we
by YeGoblynQueenne 8y ago
>> The more important question might be: can we ever have a fair fight between
humans and machines?
Fair or not fair, there is no API to the real world. If we are going to create
machines that can learn and think outside of simulations, however complex they
may be, these machines will need a way to interact with the physical
environment.
Gary Marcus is on the right track here. Building systems that can "handle the
complexity of the real world", as per OpenAI's stated goal according to the
article, is incredibly ambitious and pointing out the vast distance separating
the current state-of-the-art from that lofty goal is, well, only fair.
I mean, if you think about it, back in the '70s, in the original AI Winter,
one of the big criticisms of AI research was that it languished in simulated
environments like blocks world and didn't perform nearly as well in the real
world. And here we are today, celebrating a bright step on the path to
conquering yet another simulation.
- piyh 8y agoOur simulations have gotten way better in 40 years. You could teach an AI the basics of simulation driving or flying that would work as a baseline for the real world.
- YeGoblynQueenne 8y agoUnfortunately, modern, statistical machine-learning based AI is extremely bad at generalising from one environment or one context to another. And, training one some task in a simulation and then performing the same task in the real world requires a very strong ability for generalisation. That is because it is extremely expensive to simulate the real world with any fidelity and therefore every simulation is "cutting corners" - and really, really big corners at that. This gap, between reality and simulation must be covered by generalisation, but our machine learning systems genearlise too poorly. As a result, training in simulated environments doesn't help handle the full complexity of the real world. Even if we had robot bodies that could move as freely and manipulate objects with as much dexterity as they can do in simulations.
- Isinlor 8y agoWell, for very simple, repetitive tasks it does work: https://blog.openai.com/generalizing-from-simulation/ https://blog.openai.com/generalizing-from-simulation/ But you are right that it will fail on anything that is hard to simulate. And a lot of trivial things are very hard to simulate. Tesla recently failed at things like plugging two cables together. Picking stuff like bags at Amazon warehouses may be another example.
- YeGoblynQueenne 8y agoIt's even hard to tell whether that robot hand pushing the puck is actually "generalising" like the article claims. Maybe it is, maybe the task is set up so that it makes it possible for the robot hand to push around the puck even when it's on a bag of crisps. It's very difficult to know for sure.