8 ms·
Grasping Robots Compete to Rule Amazon’s Warehouses
- deleted 9y ago[deleted]
- haburka 9y agoI love how bad robots are at picking stuff up. It's amazing how far science has advanced but the act of picking something up that hasn't been seen before is almost impossible to do reliably. It really helps illustrate how AI is really not as powerful as people think it is.
- krapp 9y agohttps://en.wikipedia.org/wiki/Moravec%27s_paradox https://en.wikipedia.org/wiki/Moravec%27s_paradox It's not even just picking something up, it's picking one specific item out of an arbitrarily messy or overstuffed bin without dislodging or dropping anything else. Items in a bin can be wedged anywhere, in any position, in nondescript boxes only identifiable by the ASIN, or a vague natural language description. It's a hard visual logic, inference and manual dexterity problem made harder by unpredictability and harder still by the need to meet quotas, and every job has its own mess of them. And on top of that, employees in Amazon warehouses are often cross-trained to save costs, which means you either need one robot that can unload, decant, move juice carts, pick, stow, pallete-stow, etc, at a moment's notice or else multiple dedicated robots for each task. It's something humans do so easily that Amazon can justify paying almost nothing for the work, but still way beyond what AI and robotics can achieve. The Kiva pods seem to be the current state of the art for Amazon warehouses, and all they seem to do is move bins around (and can't even get that right sometimes.)
- joshvm 9y agoThis is an important point. Grasping itself isn't that difficult if you know the object and its orientation. It's a pre-configured action (grip here and here, move, release). Ocado, a large online-only grocery store in the UK have a demo they show trade shows that uses a suction cup. They don't bother with a grasper, they just locate a big enough surface to latch onto and use that. That's considerably easier than picking things up using fingers and you can use fairly simple algorithms to detect planar surfaces. The problems start when things are tightly packed. One object might be in the way of your gripper so you can't take the thing you want. What happens if you drop the object? Does your robot know how to move things aside to grab the item you want? And on top of this you have the whole issue of detecting objects in a cluttered environment: this requires state of the art semantic segmentation, robust 3D vision that will work on non-cooperative targets and a classifier that can work with occlusions and huge numbers of objects reliably. I think it's reasonable that some items can be scanned upon entry into the warehouse, e.g. on a laser triangulation turntable that also grabs a video as it rotates. With this sort of task you want to exploit as many priors as you can find. If you look at papers (and factories), you see a lot of tricks: objects on flat surfaces that make segmentation easier, small numbers of known objects, etc.
- wiz21c 9y ago>> The problems start when things are tightly packed. One object might be in the way of your gripper so you can't take the thing you want. Simple algorithm for that : Annoy (pun intended) towers :-)
- krapp 9y ago>I think it's reasonable that some items can be scanned upon entry into the warehouse, e.g. on a laser triangulation turntable that also grabs a video as it rotates If it could be done quickly enough with enough volume, maybe, but the constraint is that items have to be loaded off the truck, scanned and stowed into a bin (which makes them available for purchase on the site) as quickly as possible.
- joshvm 9y agoYou could have a conveyor system which would cover 5/6 directions without too much trouble, and it'd be fast enough for real-time capture. Or you could automate the most common purchases e.g. Amazon basics items, Kindles, electronics. They could even ask sellers to provide models or dimensions.
- amelius 9y ago> uses a suction cup I wonder how they pick up books using this method? Books are difficult because they appear to have hard surfaces on the side, which turn out to be not so hard and not suitable for gripping.
- joshvm 9y agoProbably not an issue for them, Ocado sell pretty much only food so it'd be for boxes/bags mostly. It's not been deployed yet though. I think they're also testing gripper robots for picking up larger items like bottle packs. Also books, unless they're shrink wrapped, have a tendency to open which I imagine would be a pain.
- sjg007 9y agoWell just sell Ebooks.
- vedant 9y agoAlternatively, it helps illustrate the complexity of the problems solved by natural selection over long periods of iteration.
- dibujante 9y agoYeah. You (I assume, unless you are a dog on the internet) and I (definitely not a dog) are the result of something on the order of billions of iterations of the "grasping hand" problem.
- jacquesm 9y agoIt's incredible how versatile our hands are. Simple pressure, two jawed chuck, three jawed chuck, four jawed chuck, roundgrip, tweezer grip, scoop and all that in a tiny, totally quiet package with force feedback across the whole surface. Mimicking that mechanically is a major challenge, it has nothing to do with AI per se.
- QAPereo 9y agoIt starts to click when you think about how many years it takes us to form those basic skills, refine them, and then the years spent practicing specific applications. All of this still requires dedicated trainers in the form of parents, driven by love and commitment. It's not a trivial challenge in any form really.
- davidreiss 9y agoNot even just on an individual basis. If you think about how long it took for dexterous hands to develop on an evolutionary basis, it took tens/hundreds of millions of years or even billions of years depending on where you start from. Also, there is an interesting theory that humans hands not only evolved to grab things, human hands evolved to form "efficient" fists for punching. http://www.latimes.com/science/sciencenow/la-sci-sn-human-fist-punching-evolution-males--20151021-story.html http://www.latimes.com/science/sciencenow/la-sci-sn-human-fi...
- deleted 9y ago[deleted]
- Govindae 9y agoI've seen AI learn to walk in simulation, I've never seen one learn to tie a shoe.
- digi_owl 9y agoBecause the developers have never seen the need...
- Symmetry 9y agoIf you think you've got a really good solution for robotics grasping you shouldn't be competing in the Amazon Picking Challenge given the IP terms. We (Righthand Robotics) think we've got a handle on the problem but didn't want to get involved for that reason. There are some other companies out there with interesting solutions who weren't involved either. EDIT: Pun retroactively intended.
- amelius 9y ago> you shouldn't be competing in the Amazon Picking Challenge given the IP terms. This makes me wonder. Why did people compete for the Netflix prize, [1]? Were those IP terms better? [1] https://en.wikipedia.org/wiki/Netflix_Prize https://en.wikipedia.org/wiki/Netflix_Prize
- mattnewton 9y agoProbably has to do with the different nature of the industries: robots versus software
- Symmetry 9y agoPeople are competing in the Amazon Picking Challenge too! But the picking prize is just $50,000. If it were $1,000,000 like the Netflix prize I'm sure there would be more competition.
- robotresearcher 9y agoThe cost of participation is totally different. Physical robot vs. pure software.
- deepnotderp 9y agoActually there are a couple of companies and labs who are close to (if not already solved) the problem, but no sane person is going to compete in the Amazon Picking Competition if they've actually solved it.
- gozur88 9y agoThe difference with robots being it only has to be figured out once and the entire next generation of robots will be able to do it.
- amelius 9y agoWhat kind of neural network setup would be suitable for this kind of problem?
- goatlover 9y agoIt's interesting because the AI founders like McCarthy considered the intellectual challenges to be hard, and the robot challenges to be relatively easy. They would have probably been really surprised that we'd have a superhuman Go player before we had a robot that was just average at picking up arbitrary items.
- digi_owl 9y agoHumanity seems to underestimate the mental activity needed for limb control because so much of it is subconscious.
- gozur88 9y agoI believe that. It takes, what four or five years for a kid to learn how to catch a ball?
- gumby 9y agoA good part of that is that the kid's nervous system is continually being detuned due to growth. Consider that dog learns how to catch a ball reliably once it has reached full size. Interestingly the myelin sheath around your peripheral nerves thins as you grow. I have always assumed this is to reduce capacitance so that signal propagation time between (say) your fingertips and brain remains roughly constant as your arm gets longer. I don't know if anyone has ever studied this though.
- joeyo 9y agoYou may be right that thinning during maturation could serve a purpose, but if so you have the effect backwards: thinner myelin should mean higher capacitance (C ~ A/d) and slower conduction velocity. One would expect, if anything, that the myelin would need to get thicker as the limb lengthens. Perhaps nerve fiber diameter also increases with maturation---which also results in faster conduction velocity---and the myelin sheath thins to compensate.
- danesparza 9y agoI don't go for reality TV. But this would be a reality TV show I would watch: Competing to be the robots in Amazon's warehouses.
- saosebastiao 9y agoI find it interesting that they try so hard to eliminate warehouse workers, all the while making structural and capital decisions that ultimately increase inventory, shipping, planning, procurement, split shipment, and reverse logistics costs...all of which add up to way more of a cost problem than the handful of cents per unit of warehouse processing costs. Amazon's cost problems have almost nothing to do with warehouse workers and everything to do with management and their inability to comprehend the consequences of their rash decisions. And because their capital plan is consumed by these bad decisions, they are quite literally locking them into place. I'm increasingly convinced that amazon has opened themselves up to competition on simultaneous price and performance fronts, even with relatively few robots and a unionized and well paid work force. A few key structural decisions made up front by intelligent and informed people will make all the difference.
- pj_mukh 9y ago"capital decisions that ultimately increase inventory, shipping, planning, procurement, split shipment, and reverse logistics costs." That's interesting! What are these decisions? I'm guessing there is a natural increase due to Amazon's growth but are they making any structural changes to make the system more unwieldy?
- saosebastiao 9y ago1) Inventory growth. Inventory turns have decreased every year (look at their public statements!), to the point where they are worse than brick and mortar retail. Some inventory growth is good...you need to buy more stuff to sell more stuff. But a healthy company would see increasing inventory turns over time, leveling off once they figure out what items are worth stocking and what are not. 2) Warehouse growth. The underlying assumption is that if you're closer to the customer, you save more money on transportation. That's true to some extent, but they fuck it up in other ways: fragmenting inventory resulting in split shipments (a way bigger deal than most people realize, I wouldn't be surprised if this alone overwhelmed the savings from shorter linehauls), increasing safety stocks, truck endpoint combinatorial explosions, truck scheduling issues, inventory balancing problems, reduced truckload utilization factors from reduced shipping volumes per warehouse and destiation. Larger warehouses have their problems, but compared to the issues that more warehouses cause, they are very solvable in comparison. 3) Random stow processes and path-based picking are hard wired into everything about their operations. From their software to their warehouse design to their metrics. It works phenomenally for books, but not so well for things that aren't physically shaped like books or have sales distributions like books. Inbound costs with random stow are orders of magnitude higher than case-level stow for case-packed items, experience exponential growth in costs when inventory shelves are at high levels of utilization, and random stow combined with path-based picking means your pick rates decrease almost linearly with inventory turns (more inventory per unit sold means walking farther between each pick which means more labor cost per pick, and prioritized placement to fix the pick cost problem just shifts costs towards a much more complex and costly stow process). 4) Refusal to reevaluate decisions made in the past that no longer apply. Two big examples are random stow processes, and inventory selection. - Random stow vs other stow methods were evaluated back when Amazon was a bookstore, and they were an astounding win. Now that Amazon sells everything, there are plenty of methods that are vastly superior, and even the possibility of different methods for different products, but they've built out several hundred warehouses under the assumption of random stow and would require monumental efforts to retool them and write the software to support it. - Inventory selection is seen as a universal good and is never going to stop growing. That's fine for a business growing into new sectors and categories, but when you have 3000 different brands and models of staplers, you've passed the point of marginal benefits exceeding marginal costs. The effect on inventory turns, warehouse growth, and warehouse operations alone is staggering. 5) Their Kiva robots work beautifully in small warehouses with low shipping volumes, but have severe scaling issues in larger warehouses due to inherent design problems. They have centralized path planning which is an NP-complete problem that can't keep up with the real time requirement at large warehouses. They require whole-warehouse shutdowns every time a single piece of inventory falls off a shelf. They experience physical deadlocks due to inventory being tied up in multiple conflicting processes at the same time. Sure, they eliminate picking labor, but they replace it with decreases in stow and packing productivity, and unseen to it all is that the fact that dependence on Kiva means small warehouses which means you further explode the logistics problem by having more warehouses and more fragmented inventory. 6) They introduced and scaled FBA without item-level inventory accounting. Now, due to co-mingling, fraud and piracy are a systemic problem. And it's not entirely solvable without item level accounting...which would require physical and technical changes to every step of the process all the way from the shipper to the warehouse(s) to the customer. If I had to summarize Amazon's core problem, it is this[0]: they optimize the things that are easy to measure, because they don't know how to think about the things that are hard to measure. Warehouse labor is easy to measure...the effect of growing their warehouse network on logistics and inventory management is not. So they grow their warehouse network, see their costs increase, shrug their shoulders, and then double down on labor costs because that's the only thing they can understand. [0] https://news.ycombinator.com/item?id=14920458 https://news.ycombinator.com/item?id=14920458
- Animats 9y agoIt's amazing how bad robot manipulation is in unstructured environments. It hasn't improved a lot in 40 years. There's was a DARPA manipulation challenge in 2012.[1] Simple manipulation is slow and clunky, even with really good robot hands. [1] https://www.youtube.com/watch?v=jeABMoYJGEU https://www.youtube.com/watch?v=jeABMoYJGEU
- robotresearcher 9y agoGrasping Robots Compete to [be minimally competent at picking stuff up and after many years trying are still hilariously bad compared to the humans that] Rule Amazon's Warehouses. They are getting better these days, but let's not get too breathless about it. That headline is very misleading.
- haberdasher 9y agoIt'd be pretty amazing for Google X to participate. They're good at getting robots to pick things up. https://www.youtube.com/watch?v=l8zKZLqkfII https://www.youtube.com/watch?v=l8zKZLqkfII
- SpikeDad 9y ago'Send someone with a gurney. We've got a robot hand grasping a man's penis out here".