3 ms·
I don't really understand why "Killed by: Saturation" is needed - what other options are there? It would also be nice to see the "unbeaten" list: standardized
by levocardia 2y ago
I don't really understand why "Killed by: Saturation" is needed - what other options are there?
It would also be nice to see the "unbeaten" list: standardized tests LLMs still fail (for now). e.g. Wozniak's coffee test.
- themanmaran 2y agoWozniak's coffee test would be a really fun one to attempt. As long as you could get a capable enough robot, I imagine it's possible. Something like the Spot Arm[1] would be sufficient. Something like: - Key the robot controls to a series of tools (move_forward(x), extend_arm(y)) - Add a camera and pass each frame to the AI model along with the task "make a cup of coffee" and the list of available tools it can call. And it would likely succeed some percentage of the time today! [1] https://bostondynamics.com/products/spot/arm/ https://bostondynamics.com/products/spot/arm/