I am not sure if that is the case. If something is viewable to the public, I can record all day and film everyone's number plates as I am not a business and do

I am not sure if that is the case. If something is viewable to the public, I can record all day and film everyone's number plates as I am not a business and don't need permission so I am not a data controller. If the people I am recording do not like that, they can feel free to use private roads only (which are not viewable from a public place) or not have a vehicle and problem solved. The onus is on them. As you say though, there are many specific's such as filming from public to within a private dwelling and causing distress. etc