VPS's should offer framework specific images. A quick provision will get you Passenger/Apache/Capistrano. At that point you basically have a Heroku-like setup

VPS's should offer framework specific images. A quick provision will get you Passenger/Apache/Capistrano. At that point you basically have a Heroku-like setup up and running. While trivial to set up yourself, it is just as trivial for the hosting company to offer the snapshot for most major frameworks.