>Do the GPUs just sit there with the models on them when the models are not in use I've assumed that as well. It makes sense to me since loading up a model lo

>Do the GPUs just sit there with the models on them when the models are not in use I've assumed that as well. It makes sense to me since loading up a model locally takes a while. I wonder if there is some sort of better way I'm not in the know about. That or too GPU poor to know about.