During my graduate studies I did something similar [1]. We modified stock RC cars and put a Kinect-like sensor on top, and then raced them around a track. In te

During my graduate studies I did something similar [1]. We modified stock RC cars and put a Kinect-like sensor on top, and then raced them around a track. In terms of reaction time, the fastest car was going 128 MPH at full scale. The car is mostly open source, from the parts list, assembly instructions, fabrication files, and software. The only wrinkle is that we used Matlab, because that's what we use in our lab, but really you can use anything you like. ROS and open CV would be a good combo. Here is the video of the "final exam" for the course: https://www.youtube.com/watch?v=jwRjv3D7lGo https://www.youtube.com/watch?v=jwRjv3D7lGo If you watch, you can see the local planner had to be a little more robust than just a lane follower, since there was significant "clutter" at various points in the track. So the students had to have some logic in there that filtered out that noise and kept the car in its designated lane. [1]: http://vader.cse.lehigh.edu/roscar/ http://vader.cse.lehigh.edu/roscar/