Maybe it my problem, because I don't understand all my options. But when I spin up a new cloud server built on some image from a cloud provider, I am not sure

Maybe it my problem, because I don't understand all my options. But when I spin up a new cloud server built on some image from a cloud provider, I am not sure how I can verify this certificate. How can I verify I am not being Mitm'ed on this new server? Or maybe the cloud provider is dropping the ball in not giving me the fingerprint when I request its creation? But yes, it does seem broken to me.