Cool idea. I did something similar- a whiteboard with various magnetic icons that were original SVGs. I trained an object detector to recognize the different

Cool idea. I did something similar- a whiteboard with various magnetic icons that were original SVGs. I trained an object detector to recognize the different icons and extract that into a data structure depending on the icon orientation and relative positioning. I wanted to patent that as a brand new way of programming- visual programming with real objects. Never went anywhere with it.