4 ms·
I'm curious how far away we are from a robot that can pick up LEGO pieces and stack them together according to the assembly-booklet. And what kind of DL models
by amelius 2y ago
I'm curious how far away we are from a robot that can pick up LEGO pieces and stack them together according to the assembly-booklet.
And what kind of DL models would it use?
- fragmede 2y agoWe're a ways away from a hand and arm that dexterous, though there's been promising developments given all the money going into AI lately. We're also a ways away from having a machine "read" a PDF of LEGO instructions and then modeling it as a digital twin. It's being worked on though, so maybe in our lifetimes. That's an AI I'd rather not see though - that's the fun part OF LEGOs. If you really want a model completed, pay a local teenage (or laid off software dev) to do it.
- amelius 2y ago> We're a ways away from a hand and arm that dexterous So you are saying it is not possible to stack LEGO pieces by a remotely controlled arm (with a human operator)? > That's an AI I'd rather not see though - that's the fun part OF LEGOs AI is already claiming all the fun tasks like writing poems and drawing kittens ;)
- Freak_NL 2y agoHave you ever assembled a Lego set rated 8+ or older? It's not about stacking bricks, it's about applying just enough pressure at exactly the right angle, whilst supporting the assembly in the right places. (Something humans can do remarkably well.) This is something you can probably program an expensive assembly robot to do if it has to repeat that same procedure thousands of times, but doing it for a whole set human operated? That only makes sense if you haven't got a set of nimble appendices and opposable thumbs, and you have the time to spare and inclination to train with the remotely controlled arm. Having an LLM do it seems fruitless at this point — and why bother?
- amelius 2y agoObviously, the reason for wanting a LEGO assembly robot is not to assemble LEGO projects, but it's to learn from the technology that makes it possible ...
- prybak 2y ago[dead]
- wussboy 2y agoBut what would be the point of that, beyond the thrill of building a robot? The joy of LEGO is finding the pieces and building it yourself, not in owning an assembled model.
- elephantum 2y agoI tried to do brick sorting (because we have great detection and classification models at https://brickit.app/ https://brickit.app/) It turned out to be much more complex than I expected. The biggest issue was grabbing. Typical approach for this type of task is to use vacuum suction actuator, but it does not work for Lego parts, because they have stubs and prevent suction from working. Also there are issues of part separation. We abandoned this idea, but I still hope that we can return and achieve something working some day.