3 ms·
Founder of Replicate here. Our cold boots do suck (see my other comment), but you aren't charged for the boot time on Replicate, just the time that your `setup(
by bfirsh 3y ago
Founder of Replicate here. Our cold boots do suck (see my other comment), but you aren't charged for the boot time on Replicate, just the time that your `setup()` function runs.
Incentives are aligned for us to make it better. :)
- moscicky 3y agoWas not aware of that that. You should probably change the docs to better explain what you are charged for. Right now it says you do get charged for boot time: “[…] Unlike public models, you’ll pay for boot and idle time in addition to the time it spends processing your requests.” Apart from boot times, we actually find replicate to be an amazing platform, congrats
- bfirsh 3y agoOops you're absolutely right. "Boot" ambiguously meant "setup" there. Fix deploying!