If you store data in containers, update your application inside the container, and treat them as long-running persistent entities, then what benefit are you get

If you store data in containers, update your application inside the container, and treat them as long-running persistent entities, then what benefit are you getting out of a container? You're essentially treating a container like a vps, so why not just run your app directly on a vps?