3 ms·
Renting tokens is exactly what I had in mind, and I don't see how it has the same issues. Sure, if you go for absolute bottom of the barrel than you can expect
by int_19h 17d ago
Renting tokens is exactly what I had in mind, and I don't see how it has the same issues. Sure, if you go for absolute bottom of the barrel than you can expect "changes in model quality", but in general that is not so, and you can pin specific model releases etc. Inconsistent speeds and service outages apply to your own hardware as well (say, power goes down). This all isn't even unique to AI, it's generally why cloud compute quickly became dominant.