I haven’t had as much fun with inference models as I’ve had since finding out Fly GPU servers start and stop at the drop of a hat. I can literally boot the ser

I haven’t had as much fun with inference models as I’ve had since finding out Fly GPU servers start and stop at the drop of a hat. I can literally boot the server for the 10-20s it takes to run a bunch of generations, and have it shut down automatically afterwards. It feels like magic. Sure, creating the image after a new deployment takes up to two minutes, but once it’s there it’s incredibly fast.