4 ms·
Exactly! Even if you won't be able to use some model tomorrow, you can still make money by using it today! And in the age of limited compute, spiky workloads
by miki123211 4mo ago
Exactly!
Even if you won't be able to use some model tomorrow, you can still make money by using it today!
And in the age of limited compute, spiky workloads and constant outages, building a mechanism to fallback to a weaker model when your primary choice isn't available is smart anyway.