3 ms·

A 36% success rate on screwing in a light bulb means there's probably something to LeCunn's take that VLM/VLA models aren't going to be the thing powering tomor

A 36% success rate on screwing in a light bulb means there's probably something to LeCunn's take that VLM/VLA models aren't going to be the thing powering tomorrow's robots, but only time will tell.

LarsDu88 2mo ago
Where did you get this perf metric? I couldn't find it in the release
- striking 2mo ago
  Second chart (it's to the right of the first chart and clicking it to scroll is easier than otherwise)
  - LarsDu88 2mo ago
    Wow screw lightbulb is lower than tie bag or close ziploc. Pretty surprising.
heaney-555 2mo ago
It's still very early days. There are many benchmarks that LLMs scored 36% on just 18 months ago that they're now at 100% on.