4 ms·
I have had good experience with Replicate and Runpod. Replicate seems to be nicer but has very bad cold boot issue. Runpod is great once you have an app set up!
by asadm 3y ago
I have had good experience with Replicate and Runpod. Replicate seems to be nicer but has very bad cold boot issue. Runpod is great once you have an app set up!
I use mix of both for my side project: https://trainengine.ai https://trainengine.ai
- bfirsh 3y agoFounder of Replicate here. Looks like you're using DreamBooth for TrainEngine. We have a beta version of really fast cold boots for DreamBooth trainings. I'll drop you an email to get you set up with it. We've got some big cold improvements rolling out across everything soon. We can also just keep models switched on to avoid cold boots entirely.
- Rastonbury 3y agoSeconding the cold boot issue, hoping it's fixed I've had to look elsewhere because I can't have users waiting 3 min for a 5-15 second inference unexpectedly, I must say I do like the site and product!