I don't know the technical details, but as I understand it with today's infrastructure "caller's phone number" might as well be a free field where you can enter

I don't know the technical details, but as I understand it with today's infrastructure "caller's phone number" might as well be a free field where you can enter anything you like. There is no authentication or verification going on there