3 ms·
Some of these are a bit more host a server for you or others to run. I wish this comparison also compared billing models a bit and any other value-adds. The co
by crazysim 3y ago
Some of these are a bit more host a server for you or others to run. I wish this comparison also compared billing models a bit and any other value-adds.
The cool thing about replicate.com is that you can use someone else's public model and it's billed to the callee. For someone like me who is gluing models together for a hobbiest setting, it's been great.
For some image identification tasks, it's been pretty neat for me to be able to call https://replicate.com/andreasjansson/blip-2 https://replicate.com/andreasjansson/blip-2 which is someone else's already deployed model which was already pre-warmed by somebody or level of activity, and get results back. For me, I've been captioning images and putting them into OpenAI prompts.
I've also myself put out https://replicate.com/nelsonjchen/minigpt-4_vicuna-13b https://replicate.com/nelsonjchen/minigpt-4_vicuna-13b to see if maybe it's an improvement in captioning. Unfortunately, it takes like 15 minutes to spin up. That said, it's currently free for me to put up. If someone else wants to run it, they can wait/pay. And they only pay for the runtime and not setup. And if it were to get popular, it'll be naturally warm for everyone. For me, it was 6x the cost of https://replicate.com/andreasjansson/blip-2 https://replicate.com/andreasjansson/blip-2, and although my experiment did not produce something suitable or usable for me, maybe those caveats are appropriate for someone else's use case, and they can super-easily reuse my deployment on their dime without costing me any money.
Not to mention that replicate also put out some pretty alright APIs or libraries to call their service. It's been consistent.
All this ease of use does come with some caveats, replicate.com is pretty expensive for the raw calls.