4 ms·
Wow okay there is a lot here, just so that I understand this correctly: 1. Make a replica of my home/ room in a game engine or a simulator 2. Generate trajecto
by indraneelpatil 6mo ago
Wow okay there is a lot here, just so that I understand this correctly:
1. Make a replica of my home/ room in a game engine or a simulator
2. Generate trajectories with RL where the reward is hand specified by me
3. Automate trajectory rewards using some proximity flags
Some stupid questions:
1. How do I build a replica of my home? Is there an SFM algorithm I could use to do this just from camera images?
2. Would this still work even if things/ furniture move around the house?
3. This data collection strategy will have a distribution shift compared to real data so it might struggle with different lighting conditions and stuff?
- ghm2199 6mo agoTo get an idea of the thing. I would find something similar to https://docs.nvidia.com/learning/physical-ai/getting-started-with-isaac-lab/latest/an-introduction-to-robot-learning-and-isaac-lab/03-available-robots-and-environments/02-available-environments.html https://docs.nvidia.com/learning/physical-ai/getting-started... Caveat here is you may not be able to use their environments or you may or may not have their kind or robots to train your roomba. But at-least you could get an idea of how RL training is done for robots like yours.