4 ms·
I skipped to the end to see if they did any local models. spoilers: they didn't.
by LogicFailsMe 11mo ago
I skipped to the end to see if they did any local models. spoilers: they didn't.
- ojr 11mo agothey are building a product and said the unit economics must make sense, local models have slower latency, unless you run a gpu on for hours which gets expensive fast
- kalleboo 11mo agoLocal models will make a lot more sense once we have the scale for it, but when your user count is still small paying cents per image is a much better deal than paying for a GPU either in a data center or physically. Local models are definitely something I want to dive into more, if only out of personal interest.