12 ms·
Toyota Research claims breakthrough in teaching robots new behaviors
- dinvlad 3y agoIf this is using gen-AI, I wonder how it "hallucinates" - would that result in jerk movements that could break something or hurt someone?
- electrondood 3y ago[flagged]
- deleted 3y ago[deleted]
- JamesBarney 3y agoStandard of living increases are made 1 job loss at a time. It sucks, we should supports people's transitions, but I don't think we should hold back progress.
- dang 3y ago"Eschew flamebait. Avoid generic tangents." https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- DoesntMatter22 3y agoTwitter still is the public townsquare. Nobody does announcements or breaking news on threads or IG.
- treespace8 3y agoThis looks impressive. Much more than even the Boston Dynamics demonstrations. Flipping a pancake is extremely difficult because each pancake is different. I know that these videos must be cherry-picked but to be able to train a Robot to do this just by demonstrating feels like a massive leap.
- irtefa 3y agoYes! In layman's terms: is the most efficient way to train these robots by showing them billions of videos of how it's done?
- GlenTheMachine 3y agoAlmost certainly not. Because the sense of touch is an important part of the problem and that data isn’t present in videos.
- hinkley 3y agoNot just touch but proprioception. Robots in human environments will have to be better at proprioception than 98% of humans. If I bump into you it’s typically anything from annoying to a meetcute. I’m a pretty big guy, but if you had to chose me to step on your foot or somebody else, it’s probably me you want, because I will shift my weight off your foot before you even know what happened (tai chi) because you will barely notice. If instead your choice is your high school bully or a robot, well for now pick the bully. Because that robot isn’t even being vicious and will hurt more.
- ekidd 3y ago> Because that robot isn’t even being vicious and will hurt more. Rodney Brooks at the MIT AI Lab was a big advocate of something called "series elastic actuators." The idea was was that you didn't allow motors to directly turn robot joints. Instead, all motors acted through some kind of elastic. And the robots could also measure how much resistance they encountered and back off. MIT had a number of demos of robots that played nicely around fragile humans. I remember video of a grad student stopping a robot arm with their head. Now, using series elastic actuators will sacrifice some amount of speed or precision. You wouldn't want to do it for industrial robots. And of course, robots also tend to be heavy and made of metal, so even if they move gently, they still pose real risks. But real progress has been made on these problems.
- 3y ago
- teeray 3y ago> Our research in robotics is aimed at amplifying people rather than replacing them Noble, but the reality is that once the genie is out of the bottle it will be used by many MBAs to replace people.
- reidjs 3y agoControversial, but we can look at this as a good thing. If your entire job is simple enough for a robot to do that job shouldn’t be filled by a human. However, the human should receive a decent standard of living, regardless of their employment, which may be politically impossible.
- endisneigh 3y ago> However, the human should receive a decent standard of living, regardless of their employment, which may be politically impossible. Not gonna happen.
- xwdv 3y agoAnd not even for political reasons.
- Alupis 3y ago> which may be politically impossible Try economically impossible for starters. Do some napkin math on how much an individual needs to live each month, and then multiply that by how many people you need to support nation-wide. The dollar amounts are staggering, and make our current annual budget (all of it!) look like mere child's play. We're talking hundreds of billions of dollars every month. It's simply not possible.
- kube-system 3y agoYou're only adding up half of the equation. On the other half, your nation's productivity has skyrocketed due to plummeting labor costs. Lets say that robots cut US 'labor' costs in half -- from about 10 trillion to 5 trillion. Add in a 5 trillion dollar tax on robot labor and you've got about 14,700 per capita to spend. And costs for businesses don't change.
- irtefa 3y agoThe prospect of robots able to manipulate liquids, cloth and other tricky materials shows how dexterous they're becoming. Major milestone. Exciting stuff!
- kristopolous 3y agoThis sounds like LoRA but for robotics, am I teaching this right?
- reportingsjr 3y agoThis sounds similar to some of the work that google has done, such as PaLM-E: https://blog.research.google/2023/03/palm-e-embodied-multimodal-language.html https://blog.research.google/2023/03/palm-e-embodied-multimo... Very exciting times in robotics!
- modeless 3y agoThis looks way better than PaLM-E because the robots they're using are more capable and the tasks much more complex. And they're doing the behaviors at the same speed a human does them while puppeteering the robot. The PaLM-E demonstrations were all shown in sped-up videos because they are agonizingly slow in reality.
- galaxytachyon 3y agoOk here it is. An LLM with physical senses. They mentioned sense of touch and I think that is a big deal. You can teach me all you want about a new color with all the text description available and it would be worse than just show me that new color. In the same way, letting an AI actually touch and interact with the world would do wonders in grounding it and making sure it understand concepts beyond just the words or the bytes it was fed during training. GPT4 can already understand images and text, it should not be long until it takes care of videos and we can say AI has vision. This robot from toyota would have touch. We need hearing and smelling and then maybe we will get something resembling a true AGI.
- nradov 3y agoThere's no reason to expect that such advances will get us closer to a true AGI. I mean it's not impossible, but there's no coherent theory or technical roadmap. Just a lot of hope and hand waving. I do think that this is an impressive accomplishment and will lead to valuable commercial products regardless of the AGI issues.
- criddell 3y ago> true AGI What is that? Most humans have general intelligence, but do other apes? Do dogs? A quick google search suggests that the answer is yes. If that’s the case, then this approach may indeed yield an AGI but maybe it’s not going to be much better than a golden retriever. Truly excellent at some things, intensely loyal (I hope), but goofy at most other things. Or maybe just as dogs will never understand calculus, maybe our future AGI will understand things that we will not be able to. It seems to me that there’s a good chance that AGI (and intelligence in general) is a spectrum.
- m_fayer 3y agoThere’s a wonderful novella by Ed Chiang called “the lifecycle of software objects” that addresses your thoughts exactly. Highly recommended.
- 1970-01-01 3y agoToyota hinting at AGI in 2 years time? Yes, I'm skeptical. "Siri, make me a sandwich" "You're out of bread, would you like me to bake some bread and then make your sandwich?" isn't going to happen by 2025.
- 3seashells 3y ago[flagged]
- reaperman 3y agoI can honestly see this by 2030. Just not reliable or safe enough for a consumer product. There will be a gap between “can be done reliably in testing” (probably doable by 2030 even in a randomly chosen house that’s not part of the test set) and “safe enough for consumers, children, and pets to not get injured by the movements of a robot who is strong enough to lift and carry a 40lb bag of flour or 40lb laundry basket”. That safety gap for “co-working” robots will be very difficult to close enough for the CPSC to be satisfied and also avoid expensive class-action or individual lawsuits.
- anticensor 3y agoYou forgot the sudo: https://xkcd.com/149 https://xkcd.com/149
- moffkalast 3y agoRemindMe! 2 years Ah wait, this isn't Reddit. Well anyhow we'll see I suppose. My money would be more on unfreezing and reheating bread instead, dough rising takes too long for practical sandwich creation.
- hammock 3y agoWe already have robots that make sandwiches. And robots that make bread. And robots that order sandwiches and bread. And robots that deliver sandwiches and bread. So maybe it’s not one robot, but 3-4 robots that interface with each other.
- deleted 3y ago[deleted]
- stuckinhell 3y agoThis seems like world changing technology, I can't believe these robots can learn complex motions just by watching a teacher.
- modeless 3y agoThey don't learn by watching. That would be another breakthrough entirely. They learn only by physically completing the task under the complete control of a puppeteer. Still very cool though.
- micromacrofoot 3y agolearning through a shared experience!
- jsemrau 3y agoMy understanding is that the puppeteer records the same movement over and over again and this dataset of trajectories (pose, speed, acceleration) is then "diffused".
- NalNezumi 3y agoCool to see Russ Tedrakes recent work! His online course Underactuated Robotics is a very good course to get a grasp on the complexities faced in robotics. It's exciting to see someone with a bit more deeper knowledge than "Flex tape slap LLM on robotics" featured here, which is majority of Robot Learning work upvoted on HN. There's more to it than just language learning to be solved before we can have proper embodied agents in the chaotic real world.
- kelseyfrog 3y agoWake me up when a robot is the one teaching the other robots. The bottleneck in requiring human instructors makes this basically a no-go for me.
- dpeckett 3y agoIn the linked TRI video they hint they are working on building generic dexterity models. If that proves possible, maybe oneshot/fewshot learning of dexterous behaviors isn't farfetched.
- JoeAltmaier 3y agoOnce a robot is trained, it's training dataset can be copied to other pretty quickly? So that's 'one robot teaching another'.
- giardini 3y agoI don't see any breakthrough here. I think it's simple marketing: "We're among the first using a variant of LLMs to enhance robotic behaviors." The first pancake sequence starts with the pancake half off the baking surface and in danger of falling to the floor. So the device pushes the pancake back onto the baking surface. Good enuf if the pancake is "stiff" (already cooked and rigid). So hope you like your pancakes well-done! And the pancake-flipper doesn't flip the pancake - it slides the spatula under the pancake and then, just like a robot, rotates the spatula until the pancake drops. In any case, fuggeddabout "eggs over easy".
- danielbln 3y agoI don't see any innovation here. I think it's simple hype: "We're among the first to use a variant of these 'horseless carriages' to enhance mobility." The first jaunt starts with the vehicle half off the pathway and in danger of colliding with a fence. So the operator manipulates the wheel to guide the contraption back onto the path. Fine enough if the path is "level" (already flattened and firm). So hope you enjoy your rides on well-paved roads! And the operator doesn't truly control the vehicle - they merely grasp the steering device and then, just like a carriage driver, rotate the wheel until the vehicle alters its direction. In any case, fuggeddabout "tranquil and fragrant travels".
- zwieback 3y agoDr. Ruth might have some ideas what other skills robots should learn.
- colordrops 3y agoI'm pretty ignorant of state of the art robotics and had assumed for years that approaches like this were used, e.g. by Boston Dynamics. Surprising to see that it's a new thing.
- jononomo 3y agoHas Boston Dynamics ever done anything other than produce a viral video approximately every 5 years? Mr Beast produces a viral video twice a month.
- colordrops 3y agoHave you not observed the content of those viral videos? Who else is doing robotics at that level? Extremely complex, natural bio-mimicking movements I've not seen anywhere else.
- jononomo 3y agoWhat has a Boston Dynamics robot ever done, other than star in a Boston Dynamics video?
- colordrops 3y agohttps://bostondynamics.com/products/ https://bostondynamics.com/products/
- jononomo 3y agoThanks for making my point -- in the "real world" they produce mundane robotic arms for warehouse work.
- colordrops 3y agoYou ignored the quadruped.
- lbussell 3y agoIf I had to guess, we’re less than 5 years away from seeing real-life C-3PO.
- nradov 3y agoAs long as you don't mind the extension cord.
- modeless 3y agoI'll step over an extension cord all day long if it's powering a robot that does the laundry and the dishes and the house cleaning for me.
- seanr88 3y agoI would disagree. All of what we are seeing from this latest surge in AI is essentially jumped up predictive text. To get to C-3P0 there is a whole additional layer of Intelligence needed. C-3P0 can make plans and execute those plans. This latest wave cannot reason about the world, it does not know or understand the world it just assembles words (and here motions) in a way that we value. It is not planning anything.
- modeless 3y agoThat's the easy part. Making high level plans is trivial compared to the fine motor control and dexterity and sensing necessary to do things like turn a T-shirt inside out or install a fitted sheet or crack an egg or whatever. If you give me a robot with all the fine motor skills necessary for all the steps to cook a meal but no planning capability whatsoever, I'll have that robot cooking your dinner within a year.
- moffkalast 3y agoI think you're giving C3PO too much credit for the bumbling idiot he usually is when on screen. Well aside from calculating the odds of successfully navigating an asteroid field, but I'm sure GPT 4 will let you know what that is just as easily, as well as translating any language into any other language which is supposedly 3PO's whole schtick. Also: > can make plans and execute those plans https://github.com/antony0596/auto-gpt https://github.com/antony0596/auto-gpt > cannot reason about the world, it does not know or understand the world it just assembles words They can reason a surprising amount given that they only work with text. With vision/actuation encoding there's potential for far more. Remember, it doesn't have to be smart or conscious as long as it gets the job done with cold hard statistics while just appearing as such. A submarine does not swim but crosses the ocean just the same.
- rcarr 3y agoThis is getting pretty close to how I think we get to the general purpose humanoid robot. This is how I see it playing out: - You have your Boston Dynamics style humanoid robot at the job site, lets say it's a bricklayer for the purposes of this example. - You have a human somewhere offsite in an open room with an omnidirectional treadmill floor, and cameras and depth sensors positioned all around the room. They're wearing a Hollywood style motion capture suit and have a VR headset on so they can see what the humanoid robot sees through their cameras. - The human then acts as they would on site, walking up to the pile of bricks, picking them up, placing them etc. The robot moves in real time on the job site, mimicking whatever action the human performs. I don't know if you'll need props to do this properly or if the muscle memory from years on the job will be enough for the humans to get the motions right. - You log all the data. You then have someone watch through the video stream, labelling each action that is being performed. - You run it all through a machine learning algorithm, until you get to the point where you can just send the architectural plan to the robot and essentially say "Build this wall for me".
- tshaddox 3y agoAnd yet, as far as I know we don't even have mature implementations of this even for machines with much courser movement whose movement are controlled by a loose physical mapping to the human operator's movements. Things like excavators with dual joystick controls.
- ramesh31 3y agoThis is precisely how Comma and Tesla do self driving.
- wegfawefgawefg 3y agocomma does raw input to output behaviour cloning like you propose. interestingly, tesla does not. via there last public ml update, theyre self driving architecture still involves a path generator and evaluator combo, and a lot of seperately designed sensor fusion steps. parking is done via ppo reinforcement learning i think.
- martin_henk 3y agoGoogle kuffner
- neom 3y agoWebsite isn't loading for me, but found the video on the Toyota research youtube: https://www.youtube.com/watch?v=w-CGSQAO5-Q https://www.youtube.com/watch?v=w-CGSQAO5-Q
- deleted 3y ago[deleted]
- aniken 3y agoThanks. In the video around 2:40, he describes it as a “kindergarten for robots”, that’s an interesting way to think about it. I wonder if it would be possible to crowdsource the training of new tasks with a standard training tech protocol? That way you bid on the task you want and someone who solves it gets a bounty and everyone benefits? The point is there’s a long tail of tasks and a centralized lab probably can’t do them all.
- BillSaysThis 3y agoThis seems pretty cool. But I'm not clear how someone can be a (full-time) professor at MIT and also be a (full-time) vice president at TRI. I've seen this kind of two-job situation before but never understood how it's practical, unless the person works 70+ hours a week.
- epolanski 3y agoYou probably still 40 hours week or less, but you're so expert in those fields that your 10 hours of work cannot be replaced by somebody else working full time. In software engineering terms, you would gladly pay a full good salary and give a good role to John Carmack to work on your projects 6/7 days per month anyway, because he's John Carmack.
- BillSaysThis 3y agoI guess but that feels more applicable to an individual contributor role, albeit a very senior one. VPs I've known in my 30+ years in software are fully booked all day every day. A professor maybe gets to count his outside work as part of his research efforts but what about say class load, mentoring grad students, serving on committees, and the like?
- endisneigh 3y ago> class load, mentoring grad students, serving on committees, and the like that's the neat part. you don't
- BillSaysThis 3y agoWoah!
- epolanski 3y agoI can't but point the reality of modern college education: professors nowadays are mostly fundraisers than teachers or lab directors. This is especially true in the United States or Switzerland from my experience but it applies to virtually any country where the budget that goes in public research is not really enough. Their first job is really fundraising, and their second job is actually academical. I've worked for some time with scientists like Michael Graetzel[1], he was very important in the lab, don't get me wrong, he had a brilliant mind and he would still take decisions and give terrific feedback when he was in the labs, but the primary role was fundraising. You can only have the best lab if you have the most money and can hire more and the best people, that's more important than teaching or directing a lab, sadly. [1] https://en.wikipedia.org/wiki/Michael_Gr%C3%A4tzel https://en.wikipedia.org/wiki/Michael_Gr%C3%A4tzel
- anuvrat1 3y agoFor anyone interested, here[0] is the YouTube channel of Russ Tedrake, which has: - 6.4210 (2023) Robotics Manipulation - 6.8210 (2023) Underactuated Robotics [0](https://www.youtube.com/@underactuated5171 https://www.youtube.com/@underactuated5171)
- deleted 3y ago[deleted]
- JoeAltmaier 3y agoPretty fumble-fingered robots they were using. All you needed for industry up til now. Now the can learn, quickly, perhaps a more dexterous robot with flexible digits etc will become the norm.
- UberFly 3y agoThat shot of it spreading goop on bread was amusing. This video feels like an Onion production to me for some reason.
- deleted 3y ago[deleted]
- extr 3y agoYeah lol I had the same thought. I almost expected it to zoom out and be a guy with his hand up the robotic arm.
- nico 3y agoI wonder if giving cars a sense of touch is what will ultimately be the key to enable full autonomous driving Are there any cars out there that have something like a sense of touch and with it can sense the road or things that they crash into?
- jpadkins 3y agoI think cars already have a sense of touch with the road with traction control sensors. For everything else isn't touch too late, especially at high speeds? the point is to avoid the crash.
- serf 3y agothere is a lot of work to be done with gauging tire traction. it's (generally) done via comparison of RPM, but one can imagine some future tire that could realistically give feedback about how the weight is actually sitting on the tire, which portions are heating disproportionately, and which parts are experiencing friction anomalies versus the rest of the tire. that's the direction it would have to kind of go towards to reach the dimensionality and resolution of human proprioception. that kind of stuff is approached on F1 test rigs and cars. multiple IR laser therms and lidar to compare temperature across the tire at speed as well as judging deformation.
- Kerb_ 3y agoMost cars are able feel when they crash into things. Usually that means it's too late to react to it. https://wellsve.com/products/electrical-lighting-body-system/sensors/air-bag-impact-sensor/#:~:text=Air%20Bag%20Impact%20Sensors%20detect,the%20air%20bag(s) https://wellsve.com/products/electrical-lighting-body-system....
- nico 3y agoIn production yes, but it’s like kids, you don’t want them to fall and hurt themselves, however that’s how they learn Likewise, maybe self-driving cars need to get a few bumps and scratches to learn not to crash
- 3y ago
- jonplackett 3y agoOK, so those nice safe real world jobs? AI is after them too now…
- fhd2 3y agoMight just take a while for it to be economical for lots of jobs. The amount of humans is increasing, the amount of natural resources, different story.
- valine 3y agoThere’s no real dignity in work that can easily be done by a robot. A lot of these jobs make people miserable anyway, maybe we shouldn’t be fighting so hard to keep them.
- GedHawk 3y agoAll Labor has Dignity
- valine 3y agoDoes it? If I pay you to move rocks back and forth in a field does that work have dignity? Making someone work a job that could be done cheaper and faster by a robot doesn’t benefit anyone. You’re destroying economic value and wasting the worker’s time.
- thephyber 3y agoThis seems like a perception thing. Like the person moving rocks might be extremely grateful just to have a job. The mentally disabled, ex-cons, and other people who have been overlooked for work for many years all likely experience a sense of dignity in being paid to work. Perhaps they even delude themselves into thinking moving rocks is somehow useful or necessary. I always found it weird that outsiders need to dictate what dignity is, since it is an internal state/feeling about own actions. I’m not against automating high toil (the definition from the Google SRE book) jobs. But people will find dignity in their hobbies if they can’t find it at work. If they can’t find dignity there, they have been failed by society.
- eachro 3y agoAs far as I understand, getting robots to do reasonable things when faced with out of distribution experiences is super hard. How do they manage this?
- belter 3y ago"Visuomotor Policy Learning via Action Diffusion" - https://news.ycombinator.com/item?id=37581866 https://news.ycombinator.com/item?id=37581866
- Fleusal 3y ago[flagged]
- paulsutter 3y agoIt's on Really - start thinking carefully about what you’re working on. Until now the new AI have been language only, not spatial. That’s over
- zzzeek 3y agowhy, are a lot of Hacker Newsers pursuing short order cook careers?
- paulsutter 3y agoEssentially, yes How can we be sure?
- bluerooibos 3y agoBeen thinking about this a lot over the last year. It's becoming very difficult to plan for the long term future, career-wise.
- zzzeek 3y agowe use the term "Large language models" because the entire world wide web, library of congress, etc. have produced a truly vast amount of written content such that LLMs have massively large datasets available for learning. That's what I understand to be the "large" part. We have an unbelievable amount of written content available from a huge amount of datasets (both public domain and more questionably public domain). When this video refers to "large behavioral model", where's the "large" part? Where are they getting a similarly "large" amount of behavioral input data? It looks like they have a big lab with a few dozen people modeling behaviors. that's great but it's not like this number of people could produce as much content as all of digital written content.
- tamimio 3y agoI wouldn’t call it breakthrough, a step forward yes, but nit a breakthrough, since these movements are recorded and then replicated, it will be a breakthrough if for example you only teach the robot how to hold a spoon, and then it can figure out by itself how to use it.
- momofuku 3y agoHaving been a member of the robot learning community both in grad school and now in industry, I'd actually like to rightfully attribute something here since it seems that TRI is (deservedly so, I will agree wholeheartely) receiving most of the praise: The core of these advancements are powered by Diffusion Policy [1], which Prof. Shuran Song's lab at Columbia (before she moved recently to Stanford) developed and pioneered. I'd suggest everyone to view the original project website [2], it has a ton of amazing real world challenging experiments. It was a community favorite for the Best Paper Award at the R:SS conference [3], this year. I remember our lab (and all other learning labs in our robotics department), absolutely dissecting this paper. I know of people who've entirely pivoted away from their projects involving behavior cloning/imitation learning, to this approach, which deals with multi-modal action spaces much more naturally than the aforementioned approaches. Prof. Song is an absolute rockstar in robotics right now, with several wonderful approaches that scale elegantly to the real world, including IRP [4] (which won Best Paper at R:SS 2022), FlingBot [5], Scaling Up Distilling Down [6] and much more. I recommend checking out her lab website too. [1] - https://arxiv.org/abs/2303.04137 https://arxiv.org/abs/2303.04137 [2] - https://diffusion-policy.cs.columbia.edu/ https://diffusion-policy.cs.columbia.edu/ [3] - https://roboticsconference.org/program/awards/ https://roboticsconference.org/program/awards/ [4] - https://irp.cs.columbia.edu/ https://irp.cs.columbia.edu/ [5] - https://flingbot.cs.columbia.edu/ https://flingbot.cs.columbia.edu/ [6] - https://www.cs.columbia.edu/~huy/scalingup/ https://www.cs.columbia.edu/~huy/scalingup/
- mdonahoe 3y ago> our lab Which lab are you referring to?
- momofuku 3y agoI meant the academic lab that I was a part of while in grad school (would like to keep that anonymous for now, it's a smallish community). Btw, I was at R:SS 2022 and meeting the Skydio autonomy team was one of the highlights of my career as a robotics engineer!
- srsqsonyl 3y ago
- kneel 3y agoSex robots! Real world adoption will catalyze with the company brave enough to train these behaviors in.
- AtlasBarfed 3y agoJokes aside, IMO the next great "appliance" is the personal robot. It basically follow you everywhere, witnesses/records everything you do (for only your benefit/access hopefully), carries/lifts/moves things for you, fetches things for you, holds things for you, can do emergency services. Can walk a mountain with you. There was once a cartoon where a robot is instructed to protect it's "primary" from rain and proceeds to swat away all the individual drops of rain from it. A ridiculous parody, but... think about it. But yeah ... sex robots will absolutely be a thing. Might HAVE to be the thing for the female clientele with insemination abilities to continue the existence of the human race.
- midoridensha 3y agoMarriage rates are already falling; when sex robots get good enough, they'll collapse entirely. I'm not even sure if this is a bad thing.
- jdkee 3y ago"“Our research in robotics is aimed at amplifying people rather than replacing them,” said Gill Pratt, CEO of TRI and Chief Scientist for Toyota Motor Corporation." Why do CEOs make public statements such as this when the goal is humanoid robots to replace human labor, particularly in countries with declining birthrates?
- mortureb 3y agoSoftening the blow. No one wants to hear a CEO say the robots are coming for their jobs.
- bman_kg 3y agoMost of you guys have deep and practical experience with robotics and robots, for me anything that a robot is demonstrating by doing is a magic and scary thing...now I am having mild paranoia due all these progress in LLM and now these activities done by robots...What future might roll in front of us? What are your opinions on that?
- ChatGTP 3y agoStar Wars ?
- DaiPlusPlus 3y agoStar Wars is set in the distant past, not the future.
- Tempest1981 3y agoThat assumes "A long time ago" is relative to Earth 1977, vs to the narrator who may live in a far-away galaxy
- SanderNL 3y agoThis will become increasingly normal, but it’ll take a while before massive impact (ie taking your and your friends’ jobs). I’m not sure of the timeline. Humans are slow to adapt, but in 20-30 years I think the pace will pick up. I’m not too worried about the current generation, but my kids. Don’t know what to tell them TBH. I guess it’ll all be fine though. We techies tend to have a paranoid streak which isn’t becoming.
- Animats 3y agoGoogle was doing something similar, and it was on HN about a month ago.[1] I wonder how much force feedback they have. Is that big round squishy thing in the videos sort of like a big finger, with lots of pressure sensors? People have built area pressure sensors before, as far back as the 1980s, but nobody knew what to do with all that data back then. Today, too much sensor data is far less of a problem. I once took a crack at this problem by equipping a robot arm with an end wrench. The idea was that it would feel around for a bolt head, get the wrench onto it, and turn. A 6 DOF force sensor is enough for that. But this was pre deep learning, and I didn't get very far. although I did build the wrench robot setup. [1] https://news.ycombinator.com/item?id=37167698 https://news.ycombinator.com/item?id=37167698
- v9v 3y agoThe squishy thing is essentially an inflated balloon with a camera inside, which monitors the balloon's deformations: https://punyo.tech https://punyo.tech
- Animats 3y agoNice. Cameras are so small and cheap now you can do that. Computing optical flow is cheap now, too. This is something you can make from cell phone parts. Early designs were sheets of resistive plastic between crossing grids of flexible printed circuits.
- gtzi 3y agoWhen it comes to giving robots a "sense of touch", you may want to check out Bota Systems (botasys.com) – already deployed in hundreds of research and industrial robots globally.