14 ms·
Xiaomi-Robotics-1
- coldtea 3mo agoCue the variations of: "No wireless, less space than a Nomad. Lame"
- ThePowerOfFuet 3mo agoPerhaps what impressed me even more is how functional the page was without JS enabled!
- mil22 3mo agoHow well do models like these generalize to robot embodiments they weren't trained on?
- Joel_Mckay 3mo agoWhy cross-entropy follows a curve is fairly trivial to understand: https://www.youtube.com/watch?v=GlYgs6v2YfU https://www.youtube.com/watch?v=GlYgs6v2YfU In general, motion planning multi-axis systems is NP-Hard. Have a great day =3
- navigate8310 3mo agoHow are these models compared to world models by Waymo and Tesla, assuming their models are trained for recognising objects that can be further generalized for everyday chores?
- deleted 3mo ago[deleted]
- deleted 3mo ago[deleted]
- deleted 3mo ago[deleted]
- ACCount37 3mo agoCompared how? Architecturally? In training methods? In performance? The remarkable thing about this modern "full VLA" approach is that it doesn't train for an explicit "world model" at all. There's no factored world state, no pool of trajectory rollouts being sampled from. Instead, everything is rolled into the same VLA stack that does all of it internally. The world model exists, but it's implicit - the VLA learns one, but only because it helps its training objectives. Trajectories are planned ahead sometimes, also implicitly, for the same reasons. It's a very "bitter lesson" way of doing things. As far as I know, Tesla's stack is somewhat similar architecturally - a highly integrated end to end model - but the training process for FSD does include factored "world modeling" side objectives to force the stack to develop driving-relevant internal world representations. So it's in a middle ground between a classic "world model" system and this flavor of VLA - albeit surprisingly close to the latter. Whether the world modeling side objectives are principled and justified or a leftover from the days of insufficient scale is unclear.
- m00dy 3mo agoit looks like the robots are not just autonomous but also they do cooperate with each other.
- ideasarecool 3mo agoIt makes me think of why couldnt they just automate ironing and folding. I can stick stuff in the suitcase myself.
- michaelhoney 3mo agoWatching the two-handed robot has me thinking that a third hand, perhaps with a different set of capabilities (like a tentacle grip) might make many tasks easier. I realise that more limbs = more problems, but even so, having additional ways to hold and turn things would be a big help.
- snovv_crash 3mo agoAnybody who worked on a car knows an extra hand would always be helpful.
- mghackerlady 3mo agoI feel like there'll soon be a market for AI controlled enhancements like limbs. Neural interfaces seem to be a long shot, at least for now, so some kind of AI that senses the environment and intelligently react to it seems like the next best thing
- YarickR2 3mo agoI'd settle for something to just hand me required wrenches/bits/heads/etc while I'm under the car. This actually shouldn't require much.
- xnickb 3mo agoMy thoughts exactly, but to train it you'd need a lot of data with someone manually operating it. With just two hands it's enough to have a lot of footage of humans doing it. Maybe down the line the robots will be able to self-improve or someone will come up with ways to optimize this..
- amelius 3mo agoYeah, folding sheets requires 4 hands. With a large distance between each pair.
- XorNot 3mo ago
- SillyUsername 3mo agoDoes this require a given hardware platform, or for example, could I run this model with a cheap mini robot with a single camera (i.e. good enough without depth), tracked treads, and an arm?
- Havoc 3mo agoI’d imagine the training is hardware specific
- michaelt 3mo agoWhen the page says "embodiment-free (UMI)" it means they've used a standardised gripper and camera arrangement [1], while aiming to be agnostic to the type of robot arm that gripper is attached to. [1] https://umi-gripper.github.io/ https://umi-gripper.github.io/
- isusmelj 3mo agoI think this is the most satisfying video I’ve seen of a robot doing laundry. Not sure if it’s the camera angle, the 3× speed, or the music.
- zwaps 3mo agoCoining the term: Slopfold When you Robot folds your clothes but it's kinda wrinkly and sloppy but you accept it anyway because it's easier than precisely folded and pressed clothes.
- broodbucket 3mo agoI have been slopfolding since before it was cool
- Cthulhu_ 3mo agoLike outsourcing my thinking to the internet, I too did these things before it was cool.
- whereistejas 3mo agoI've been slopfolding since back when it was just called "dumping it in the wardrobe".
- ____mr____ 3mo agosaw the way it folded the clothes and thought "better than me" :/
- Cthulhu_ 3mo agoI'm not sure what the :/ implies, but if you're disappointed by your own folding techniques, spend a bit of time on it, look up some guides, and fold clothes with purpose. or something. (Rise up against the machines! Folding your own clothes is an act of resistance!)
- mghackerlady 3mo agoI've always taken :/ to be a kind of hopeless dejection mixed with apathy. In this case, it seems to convey their disappointment in their skills as well as the futility of improving
- jiehong 3mo agoPretty cool! Only 10B parameters if I correctly understand some of those histograms, which is tiny in LLM world! It bodes well for the future. The training videos seem to show human hands using the robot grippers to execute the tasks, which must have been a fun but tedious process.
- ACCount37 3mo agoYes, it's truly remarkable how small modern VLAs are. Even Tesla's FSD AI stack is small by modern LLM standards. Once the hardware is there to enable real time 100B inference on endpoint SBCs? We'd see gains in AI robotics from that alone.
- giamma 3mo agoCool video but it forgot to pack underwear in the bag!
- resiros 3mo agoThe video cuts to a new shot every couple of second instead of one continuous shot like all robotics research. This makes it hard to trust it. The robot probably failed a million team and they stitched the video from 100 experiments.
- wadim 3mo agoThe uncut video is at the bottom of the page.
- deleted 3mo ago[deleted]
- shellfishgene 3mo agoAnd it shows the robot getting into something of a loop when trying to fold the white shorts. I wonder if someone pushed a button to get it out of that.
- nitin7 3mo agoThe video also tells you that there is an uncut video at the bottom of the page. Did you take a look at that?
- resiros 3mo agoNope did not notice. Updating my comment
- karolist 3mo agoOf all the tasks I do, folding clothes takes a ridiculously small slice of my time. Is this and all the other robotics videos aimed at H&M staff?
- _diyar 3mo agoI think its a ubiquitous task which requires some amount of precision dexterity, so its an easy to digest example.
- surfmike 3mo agoSorting and folding laundry is one of the most tedious chores in our household. Do you have kids?
- ileonichwiesz 3mo agoIf I did have kids, I probably wouldn’t want them to run around a big heavy robot with very little spatial awareness.
- karolist 3mo agoFYI I do have 3 kids, no, it doesn't take that long (we share this with the wife), in a few years the kids will be able to help us with this task so it's gonna be even less time. Doing household chores is good for the kids. I wouldn't wan't this robot driving around my household when I have small children anyway...
- cynicalsecurity 3mo agoIt's meant for war. Today it folds your clothes, tomorrow it plants mines and shoots at you on a battlefield.
- Joker_vD 3mo agoSo is a pasta factory. Today it rolls and forms macaroni, tomorrow it makes bullets. Have you ever wondered why rigatoni are so wide? That's why.
- culi 3mo agoWAIC has been wild this year. We got Kimi K3 and Qwen 3.8 announced. We got robots boxing and open-sourced robotics foundation models. And we got the announcement of WAICO. At what point are we gonna start seeing American firms attending WAIC?
- FooBarWidget 3mo agoI'd like to see a serious HN discussion thread about WAIC first.
- agys 3mo agoDesigning a non humanoid robot is the way to go. The design of new tools and appliances for hybrid human/robot use will eventually follow: the zip line for the shoe bag required way too much precision work.
- fedeb95 3mo agoI can't believe someone shares my point of view. We have already many non humanoid robots to do boring stuff (underwater maintenance, stuff like that). For some reasons people tend to think that for robots to do stuff close to humans, we need human like robots. We do not. I want a swarm of insects-like robots to fight mosquitos. A snake one that fixes my pipe. A spider-like robot that cleans surfaces. Etc.
- fragmede 3mo agothe cube shaped one that I put my dishes in.
- ygouzerh 3mo agoI will suggest mix of both: some everyday tools are already built for being used with hands and legs (e.g opening a door). But indeed adding some different grip types, additional arms, etc, could be helpful.
- vishnuharidas 3mo agoExactly what I came here to say. A robot doesn't have to look like a human. Just a few arms that does the job neatly is more than enough.
- dbspin 3mo agoI think this perspective is now demonstrably false. It was basically the defacto position of most roboticists until a few months back. But we've already seen the cost of humanoid robots fall precipitously (even without the kind of mass production that genuinely useful home and real world intelligence would bring). Which seems more likely, that cheap humanoids will continue to improve in dexterity, battery life, strength etc. Leveraging the vast investment in research into real world task training. Or - that we'll redesign millions of everyday objects to fit the limitations of current task specific robots? If you answer the latter, I've got a whole bunch of mid century quirky labour saving inventions in the back room I'd like to sell you.
- mk89 3mo agoThe uncut footage is so awesome. Of course, you can mention all the things they can't do (what if there are stairs, what if the doors are smaller than the robot, etc) but it's mindblowing to see what they can do - and also the chat panel is really nice and makes it more interactive.
- drcongo 3mo ago"Did you pack the cases yourself sir?"
- nitin7 3mo agoIn the domain of hardware, what is the equivalent of a harness? How well would this generalise to any robot, versus one that is specifically built the way Xiaomi did?
- ACCount37 3mo agoConsidering that they pre-trained on non-robot data, and mid-trained on data from other robot types? I suspect that generalization would be decent for most similar platforms - things with 1 to 2 arms and 2-finger hands. You'd probably have to fine tune for good performance on a specific arm type. But this model isn't trained against hard assumptions of what the underlying hardware is.
- darkwater 3mo agoThe first few second of the shirt folding arms trying to put the t-shirt properly on the table to start folding it are at the same time amusing and scaring. What if the thing retrieves some anger-driven post from Reddit from its training data set and start literally to flip the table??
- brador 3mo agoThe fact it didn't do the 2 second tshirt fold trick shows it's just copying trained movements. This is Automation not AI.
- whereistejas 3mo agothis is what excites me most about the probable AI future. househelp is cheaply and easily accessible for most people in the east, however being able to afford a cleaner or maid in the west is a luxury. i spent a ginormous amounts of time every week keeping my house in shape. i look forward to the day when i will be able to carve out that time and get it back for myself.
- fnoef 3mo agoI wonder, what will you do with that free time you will crave?
- cognitiveinline 3mo agoHere's 10 things just starting with "A". Amateur astronomy Artistic painting Audiobook binging Aerial yoga Archery practice Aquascaping Antique hunting Acoustic guitaring Alpine hiking Astrophotography .. Need more?
- kroaton 3mo agoWork more for my boss and landlord so the fiefdom can survive.
- throw101010 3mo agoAnd pay for the maintenance costs of my new robotic servants! At least now I can finally feel like my own masters, ruling over these robots. /s
- whereistejas 3mo agoi want to read more for the most part. my reading list is evergrowing. shameless plug: https://whereistejas.com/inbox/ https://whereistejas.com/inbox/ (PS: people who comment about the faults in my website will be downvoted. im sharing my reading list, not looking for a codereview)
- Levitating 3mo agoI think anything more advanced than a Roomba won't be cheaper than a maid for actually cleaning your house.
- user_7832 3mo agoI'm not sure why some comments here are so pessimistic. I was grinning ear to ear while seeing the video. You're telling me we've finally got robots that can do our laundry? And the model is at least as free as beer? To quote the lyrics/meme, we used to pray for times like this. This is what robotics should be used for.
- echelon 3mo ago[flagged]
- onli 3mo agoWorking past your personal bedtime, part of an imaginary movement of millions might, ignoring the negative aspects of AI, empowered like commanding an army. This frankly sound psychotic, and it's exactly why uncontrolled AI usage is seen so critical by many. And all other devs will leave the field just because they prefer to work differently? That is not only not realistic, it is violence fuel.
- avilay 3mo agoNeither the Github nor the HF repos have anything on the XiaomiRobotics-1 model or datasets :-( They have a bunch of assets (datasets, code, model, etc.) for XiaomiRobotics-0 however, but I don't know much about that family of models.
- adrian_b 3mo ago> Code: Coming soon > Model: Coming soon Obviously, XiaomiRobotics-0 was their previously published model, which must have been weaker. I assume that "soon" means "a week, or two".
- GNaLVEre 3mo agoWhat if mum but venture backed lmao
- Bob_bo 3mo agoI think this robot is really well-made! Xiaomi seems to be quite controversial these days, but personally, I still really like the brand.
- epolanski 3mo agoGot two Xiaomi phones in a row, one in 2018 for 250 euros (note 8 pro) and one in 2023 for 300 (13T) and I liked them a lot. My gripe with the second one is lowish battery life, it always bites me on longer trips when my gf's Pixel 8 lasts considerably more, but was also way more expensive. Will check battery reviews better next time I shop for a phone, I don't care much for the rest.
- 6bb32646d83d 3mo agoI have Roborock (Xiaomi) automatic vacuum and it's fantastic technology. iRobot had a 10 year lead and did nothing with it. The robot is competent at avoiding clutter, clean the mops itself, leave my floor sparkling and so far has been extremely reliable.
- orangebread 3mo agoHow are there still people who look at all this advancement and the only thing they can utter is "it's not there yet?" It's clearly here, and if it's not to these nerds' expectations, it'll prob meet it in 4-6 months. This was cool asf.
- Levitating 3mo agoBecause you see a robot do one thing, doesn't mean it can do other things. We've had good robot demos for decades. For all we know they could've spent 5 years and 10 million dollars on getting this robot to fold laundry. That doesn't mean it'll be able to mop the floor better than a Roomba in a decade.
- fragmede 3mo agoNo we haven't. Back in the 90's Honda's Asimov could barely walk. Now we have robots managing to run marathons. Clothes folding had to be played back at 50x speed because the compute just wasn't there yet. It still is barely there, some of those videos are sped up. They've probably spent way more than 5 years and 10 million dollars developing that robot. Roomba already came out with a mopping robot, why would you want this one to do that?
- Fricken 3mo agoIt's probably because robots have been doing cool asf demos for half a century and they're still mostly just demos. Elon has made a lot of money greasing the 4-6 months away crowd.
- sara011 3mo ago[dead]
- meerita 3mo agoI love this future. A robot that does all the chores relentlessly of the house while you spend time just working on the stuff you like.
- spwa4 3mo agoPlease keep in mind that "uncut footage of ..." is the same as those instagram videos where people throw a basketball backwards 20 meters while drinking beer, straight into the goal. It doesn't prove this is average performance. In fact, if it was, that's not what they'd be showing.
- porridgeraisin 3mo agoFrom my skim of their paper, they have gotten robodojo 14% versus previous sota 9%. So its an improvement, but doesnt seem like a reliable model yet, which is fine. I also notice the model becomes worse with more data on the printer refilling task, so thats either a bad run or its a data point against the robustness. The transfer learning results are meaningful. 75% on new complex tasks from <10 hours of demo is really good. I believe this is a 2x improvement over the SOTA. 10 trials per task is standard for these papers but is pretty weak statistically. Memory tasks its weaker at but they have acknowledged it, and I cant see why this arch would have problems w that in the future.
- chronogram 3mo agoThis is amazing! I can see in a few years having Home Assistant use an LLM to coordinate my home while I'm away. Tell the LLM to make an inventory of my home and then send the vacuum and the robot around to clean everything up. A multimodal LLM can inspect pictures for items that need to go in the dishwasher, the laundry or needs polishing and reorganise my closets to best allocate space, make the beds, take care of the plants. It has all day to do it while the solar panels provide ample energy anyway.
- AbuAssar 3mo agothen this robot will have a face, a soothing voice and a personality... we all know where this is going ;-)
- KitN 3mo agopi.website DO SOMETHING
- Gud 3mo agoIt's happening so fast now. AI will absolutely dominate our future. I believe we have only scratched the surface of what is possible. Maybe I'm pessimistic but I always thought Bill Joy was prescient. https://www.wired.com/2000/04/joy-2/ https://www.wired.com/2000/04/joy-2/
- arh5451 3mo agoAnyone have any recommendations for robot hardware where I could test this open-source model? It would be a cool/fun project to get it working on a little robot.
- monkeydust 3mo agoWould love to see a load/unload dishwasher benchmark.
- khurs 3mo agoHow dare Xiaomi post a realistic picture of where modern consumer robotics is at. They will never become trillionaires if they don't pretend they are making a million humanoid robots by end of the year.
- jingpostmedia 3mo ago[flagged]
- iandanforth 3mo agoFor a bit of context there are some classically very hard things going on in this video, so if you're not impressed, be glad you didn't have to try to build this 10 years ago. - Coordinating two hands - Mobile body - Deformable objects - Thin affordances (bag zip in particular) - Multi-object single grasp Really a host of things that had individually been tackled as either perception or manipulation problems and probably led to more than one person's PhD here on HN.
- mosura 3mo agoReally interesting. From even before the RAM shortage there was noise in the robotics world of sensor and actuator shortages due to them being bought up in bulk by some of the major AI labs.
- deleted 3mo ago[deleted]
- wolttam 3mo agoThis is very cool, and the paradigm that scales to bringing truly useful robots to virtually all domains of life - just as LLMs have scaled to that degree across virtually all domains of knowledge work. I picture a lot of perfectly tended gardens growing food.
- thesockerr 3mo agoI hope I can use this sooner
- Kuyawa 3mo agoAlways remember this is the Model T from Ford, imagine what they will do in 10 or 100 years from now Exciting times we live in
- aavci 3mo agoPlease help me understand. Is it more effective to have a general model like this instead of a state machine that leverages other models and a deterministic set of code?
- sekh60 3mo agoAs a house spouse I want this! I _hate_ folding laundry and always procrastinate on it. Doesn't even need to be able to load the machine like they additionally show, "just" folding it is enough for me!
- ycui7 3mo agofeels like the American domestic manufacturing is done, there is no hope to save it.
- LoveMortuus 3mo agoI need a robot that would earn money instead of me. I enjoy doing the dishes, laundry and work around the house~
- yardie 3mo agoI've been playing around with Hugging Face's Lerobot[0] projects and it has been a lot of fun. To me, it has really democratized the field and has made it much easier to get into the subject without having a mechatronics degree and research lab budget. I've built 2 AI controlled robot arms: SO-ARM101 and Koch. I'm in the process of building a dual armed mobile bot[1] that looks very similar to this one. It will be interesting to see what Xiaomi's engineers push to Github. [0] https://huggingface.co/docs/lerobot/index https://huggingface.co/docs/lerobot/index [1] https://xlerobot.readthedocs.io/en/latest/ https://xlerobot.readthedocs.io/en/latest/