10 ms·

LLM's are a funny technology because on the one hand this is all undeniably impressive at the rate of what's changed from them, and yet despite that I find myse

LLM's are a funny technology because on the one hand this is all undeniably impressive at the rate of what's changed from them, and yet despite that I find myself disappointed by the lack of breakthroughs for things I don't find interesting. I like math and programming, and LLM's are pretty good at it, when are they going to get good at folding laundry for me? I think a lot of robotics work promises to solve this category of "boring" breakthroughs, and I'm optimistic we'll be able to achieve it, i just wonder when

dyauspitr 28d ago
Pretty soon. Sunday Robotics had a 3 hour stream of folding clothes with 99% accuracy. You can watch it for yourself. There’s a lot of “hand” companies with very compelling videos just over the last two months. Then there was Figure’s multi day livestream of package manipulation that was very impressive. Physical LLMs are definitely coming. Given enough training data we know LLMs can output coherent data in any space, it’s just a matter of time.
- vjvjvjvjghv 28d ago
  I feel the iPhone or ChatGPT moment for robotics is coming soon. Lots of different companies doing interesting things. What’s missing is somebody putting it together into a compelling package.
  - RivieraKid 27d ago
    I'm starting to think that a ChatGPT moment for robotics would require abandoning the current brute force approach to artificial intelligence. ChatGPT's trick was simply more data and compute. A stochastic parrot will eventually become very impressive. But we don't have an equivalent of billions of lines of code for robotics.
fooker 28d ago
The bottleneck is not really the intelligence here. We can build robots that do the things you want. Arrange a visit to Amazon's robot warehouse tour. We can't ship them because they break all the time with current technology. It would be a tough sell to have to being in a 100kg robot for servicing every few weeks. This was cars in the first several decades of automobiles. The tide shifted as soon as you could just drive the car to a neighborhood dealership for servicing. It's fun to imagine the logistics of that for robots but the material science and engineering has to advance a bit.
- parineum 28d ago
  I don't think we can build a robot that takes a pile of crumpled up clothes from the dryer and folds them (reliably without destroying any of them).
  - stickfigure 28d ago
    I think the parent's point - and what I more or less agree with - is that the problem is the hardware. Human arms and hands are incredibly intricate. Reproducing their facility with hardware requires a large number of actuators and finicky fine parts. This isn't a software problem. Industry solves it with maintenance schedules. There's probably nothing in your house that has as many moving parts as a robot needs. Your car maybe, and pretty much all it does is rotate wheels.
    - parineum 28d ago
      That's part of it but OP presented it as a solved problem but the hardware is expensive/unreliable. That's not the case. I've seen folding robots. They require standardized input, only fold one type of clothing and don't do it reliably.
  - fooker 28d ago
    Yes we can do this, and if you look for it you'll find plenty of videos of this happening. But you can't buy it because it'll break in about seven days.
- appplication 28d ago
  Just have two robots, and teach them to service each other. Problem solved! Only sort of kidding, tbh having bots service themselves (and being intentionally made in a way that they can service each other) just makes a lot of sense.
  - gryfft 28d ago
    An automated service station could be quite compact; it wouldn't need plumbing, lighting, human-comfortable climate control. Parts can be modular, and when a station gets low on spare parts, a self-driving truck could come by to pick up damaged parts and drop off replacements. We're not there yet, but I think we're a lot closer than most people realize.
rileymat2 28d ago
Unless we spend a bunch of money generating data, I can't imagine the machine steps to fold laundry are very big in the general training sets. Someone is going to have to find a hardware system, cheap enough to make it economically feasible then train it. As far as tasks people will pay a lot of money for a robot, this seems low on the list.
- vjvjvjvjghv 28d ago
  There are companies that are paying housewives in India to record all their activities. I assume laundry is part of that.
AmazingEveryDay 28d ago
I've learned that I spend significantly less time folding laundry than many of the people commenting about modern ai powered robotics. It's not meant literally is it? For instance keeping floors and counter-tops clean seems a much bigger time sink for me.
- Computer0 28d ago
  My partner spends at least 10x time on this task than I do. I think the task has a varied workload?
  - winrid 28d ago
    I think my grandmother is the only person I can think of in my entire family that legit folds cloths properly. Dying art? :D
  - hadlock 27d ago
    There's definitely a wide variance in laundry. Laundry is something that I can do to kill time while boiling pasta on the stove, for my partner it is an entire afternoon task.
- esikich 28d ago
  It's just a general "thing I don't want to do" not the thing that takes the most time. Could be taking out the garbage. It's just an example menial task.
- camel_gopher 28d ago
  Do you have kids?
ijidak 28d ago
The problem is we're orders of magnitudes better at manipulating bits at scale than we are at manipulating atoms. I'm not holding my breath for advanced robots in the home within the next ten years. But, then again, I didn't see LLMs coming either.
kart23 28d ago
f folding clothes, i wanna just have a robot be my personal chef. the amount of different tasks and capabilities a robot will need to make any meal that I can in my kitchen is huge and i feel like it’s still a while from being solved.
- quantumink 28d ago
  It may sound strange, but cooking is one of the most intense and attention-consuming tasks I encounter. I have to do it every day too. So I fully agree with this line of thought... Many a time I have considered that I would happily spend more on a personal 24/7 chef than I ever would on a car. Cars to me are utilities and should simply be efficient and optimized to purpose - food is luxury and taste, it is sublime experience and art. Maybe that's why I can't make it, treating every recipe like a strict command chain isn't how art is done. Can my taste buds be scanned?
  - spockz 28d ago
    Hire a butler/personal assistant that is also a decent cook. Sometimes there is a husband/wife pair. But be ready for substantial expense.
  - kart23 26d ago
    I mean honestly anything is taste and art. People care about very different things. Some people see their clothes as the biggest expression of themselves, whereas others don't care about their clothing but see their cars as art and a special experience thats separate from the purpose. But yeah, I think a lot of food is just practicing. And if possible, learn from someone who's food you do really like, and experiment. Just try making some dish you really liked, you'll be surprised at how far you can get.
- slfnflctd 27d ago
  The cooking robots I have seen are massively complex and can only make one dish. I agree this is a ways off. I saw a cocktail-making robot that was pretty impressive, but it was the size of a room and broke down frequently.
iamgopal 28d ago
future is on the way, three to four generation ( one each year ?) will unfold this, primarily quantum computer improving material and battery, humanoids becomes standardised and modular enough to be easily replaceable ( think ibm pc ) ( most components are simple injection moulded advance plastics , mass produced in some corner of china, self detection of wear and tear and self replace that part ), other is optical computers ( 100x lower power x 100x speed = local inference ), problem is, when this will become reality, who will benefits more ? who will hold moat ?
RivieraKid 27d ago
It's because existing models are a brute-force approach to intelligence. With enough data and compute, a stochastic parrot will become very impressive. But with robotics, there's no pre-made dataset that can be parroted. Notice that these datasets, e.g. how to fold clothes, need to be created by humans. That's as if humans needed to write algorithms like quicksort to teach LLMs how to code.
ungovernableCat 27d ago
The economic value in automating high skill and expensive labour that the most profitable corporations rely on is what attracts the most investment and effort. Once you lose your job you'll find plenty of time to do all those menial tasks you hate wasting time on. Jokes aside, programming and mathematics are just well ordered environments. Already digital and verifiable. Perfect for a GPU cluster to power through. The real world is big slow and complex in comparison.

dyauspitr 28d ago

Pretty soon. Sunday Robotics had a 3 hour stream of folding clothes with 99% accuracy. You can watch it for yourself. There’s a lot of “hand” companies with very compelling videos just over the last two months. Then there was Figure’s multi day livestream of package manipulation that was very impressive. Physical LLMs are definitely coming. Given enough training data we know LLMs can output coherent data in any space, it’s just a matter of time.

vjvjvjvjghv 28d ago
I feel the iPhone or ChatGPT moment for robotics is coming soon. Lots of different companies doing interesting things. What’s missing is somebody putting it together into a compelling package.
- RivieraKid 27d ago
  I'm starting to think that a ChatGPT moment for robotics would require abandoning the current brute force approach to artificial intelligence. ChatGPT's trick was simply more data and compute. A stochastic parrot will eventually become very impressive. But we don't have an equivalent of billions of lines of code for robotics.

fooker 28d ago

The bottleneck is not really the intelligence here. We can build robots that do the things you want. Arrange a visit to Amazon's robot warehouse tour. We can't ship them because they break all the time with current technology. It would be a tough sell to have to being in a 100kg robot for servicing every few weeks. This was cars in the first several decades of automobiles. The tide shifted as soon as you could just drive the car to a neighborhood dealership for servicing. It's fun to imagine the logistics of that for robots but the material science and engineering has to advance a bit.

parineum 28d ago
I don't think we can build a robot that takes a pile of crumpled up clothes from the dryer and folds them (reliably without destroying any of them).
- stickfigure 28d ago
  I think the parent's point - and what I more or less agree with - is that the problem is the hardware. Human arms and hands are incredibly intricate. Reproducing their facility with hardware requires a large number of actuators and finicky fine parts. This isn't a software problem. Industry solves it with maintenance schedules. There's probably nothing in your house that has as many moving parts as a robot needs. Your car maybe, and pretty much all it does is rotate wheels.
  - parineum 28d ago
    That's part of it but OP presented it as a solved problem but the hardware is expensive/unreliable. That's not the case. I've seen folding robots. They require standardized input, only fold one type of clothing and don't do it reliably.
- fooker 28d ago
  Yes we can do this, and if you look for it you'll find plenty of videos of this happening. But you can't buy it because it'll break in about seven days.
appplication 28d ago
Just have two robots, and teach them to service each other. Problem solved! Only sort of kidding, tbh having bots service themselves (and being intentionally made in a way that they can service each other) just makes a lot of sense.
- gryfft 28d ago
  An automated service station could be quite compact; it wouldn't need plumbing, lighting, human-comfortable climate control. Parts can be modular, and when a station gets low on spare parts, a self-driving truck could come by to pick up damaged parts and drop off replacements. We're not there yet, but I think we're a lot closer than most people realize.

rileymat2 28d ago

Unless we spend a bunch of money generating data, I can't imagine the machine steps to fold laundry are very big in the general training sets. Someone is going to have to find a hardware system, cheap enough to make it economically feasible then train it. As far as tasks people will pay a lot of money for a robot, this seems low on the list.

vjvjvjvjghv 28d ago
There are companies that are paying housewives in India to record all their activities. I assume laundry is part of that.

AmazingEveryDay 28d ago

I've learned that I spend significantly less time folding laundry than many of the people commenting about modern ai powered robotics. It's not meant literally is it? For instance keeping floors and counter-tops clean seems a much bigger time sink for me.

Computer0 28d ago
My partner spends at least 10x time on this task than I do. I think the task has a varied workload?
- winrid 28d ago
  I think my grandmother is the only person I can think of in my entire family that legit folds cloths properly. Dying art? :D
- hadlock 27d ago
  There's definitely a wide variance in laundry. Laundry is something that I can do to kill time while boiling pasta on the stove, for my partner it is an entire afternoon task.
esikich 28d ago
It's just a general "thing I don't want to do" not the thing that takes the most time. Could be taking out the garbage. It's just an example menial task.
camel_gopher 28d ago
Do you have kids?

ijidak 28d ago

The problem is we're orders of magnitudes better at manipulating bits at scale than we are at manipulating atoms. I'm not holding my breath for advanced robots in the home within the next ten years. But, then again, I didn't see LLMs coming either.

kart23 28d ago

f folding clothes, i wanna just have a robot be my personal chef. the amount of different tasks and capabilities a robot will need to make any meal that I can in my kitchen is huge and i feel like it’s still a while from being solved.

quantumink 28d ago
It may sound strange, but cooking is one of the most intense and attention-consuming tasks I encounter. I have to do it every day too. So I fully agree with this line of thought... Many a time I have considered that I would happily spend more on a personal 24/7 chef than I ever would on a car. Cars to me are utilities and should simply be efficient and optimized to purpose - food is luxury and taste, it is sublime experience and art. Maybe that's why I can't make it, treating every recipe like a strict command chain isn't how art is done. Can my taste buds be scanned?
- spockz 28d ago
  Hire a butler/personal assistant that is also a decent cook. Sometimes there is a husband/wife pair. But be ready for substantial expense.
- kart23 26d ago
  I mean honestly anything is taste and art. People care about very different things. Some people see their clothes as the biggest expression of themselves, whereas others don't care about their clothing but see their cars as art and a special experience thats separate from the purpose. But yeah, I think a lot of food is just practicing. And if possible, learn from someone who's food you do really like, and experiment. Just try making some dish you really liked, you'll be surprised at how far you can get.
slfnflctd 27d ago
The cooking robots I have seen are massively complex and can only make one dish. I agree this is a ways off. I saw a cocktail-making robot that was pretty impressive, but it was the size of a room and broke down frequently.

iamgopal 28d ago

future is on the way, three to four generation ( one each year ?) will unfold this, primarily quantum computer improving material and battery, humanoids becomes standardised and modular enough to be easily replaceable ( think ibm pc ) ( most components are simple injection moulded advance plastics , mass produced in some corner of china, self detection of wear and tear and self replace that part ), other is optical computers ( 100x lower power x 100x speed = local inference ), problem is, when this will become reality, who will benefits more ? who will hold moat ?

RivieraKid 27d ago

It's because existing models are a brute-force approach to intelligence. With enough data and compute, a stochastic parrot will become very impressive. But with robotics, there's no pre-made dataset that can be parroted. Notice that these datasets, e.g. how to fold clothes, need to be created by humans. That's as if humans needed to write algorithms like quicksort to teach LLMs how to code.

ungovernableCat 27d ago

The economic value in automating high skill and expensive labour that the most profitable corporations rely on is what attracts the most investment and effort. Once you lose your job you'll find plenty of time to do all those menial tasks you hate wasting time on. Jokes aside, programming and mathematics are just well ordered environments. Already digital and verifiable. Perfect for a GPU cluster to power through. The real world is big slow and complex in comparison.