I was attempting something like this but the company paying me to do it lost patience around 30 days where I was only able to identify widgets visually from moc

I was attempting something like this but the company paying me to do it lost patience around 30 days where I was only able to identify widgets visually from mockups from past training data. This was a nice step but going to know what to do with those widgets contextually got pretty rough.