2 ms·
training it will be way harder and the net probably needs to grow to eliminate external motion tracking, but I don't think the image processing and quality of i
by LeanderK 3y ago
training it will be way harder and the net probably needs to grow to eliminate external motion tracking, but I don't think the image processing and quality of image sensors is the bottleneck. These robots need the right hardware for quick inference, maybe some specialised inference chips or something, but I think if you manage to train a net that can do this, you can deploy it in principle on the robots. It looks like it has a "Intel Core i3 processor dual core" which is definitely not the right hardware for efficient (throughput + power consumption) inference.
The problem is imho that the problem is way harder and we will probably struggle to train a net that can do this in simulation. It might just be impossible with our current capabilities, we might have to wait a few years until research catches up with the problem. But I am not a RL guy and can comment only from my computer vision-perspective.