It’s not as simple as knowing that they’re using the road. In the US, they are forbidden from using the road only if you have denied them access to the road th

It’s not as simple as knowing that they’re using the road. In the US, they are forbidden from using the road only if you have denied them access to the road through either clearly posted no trespassing signs at quarter mile or less intervals or notified them either verbally or in writing that you are denying them access, and if no easement protects their access through your property to theirs, etc. So you would not only have to know, but have good reason not to deny them access other than to ignore or protect them of your own uncompelled free will.