3 ms·
As long as you are constantly diligent in staying on top of what each provider is doing that may impact you. It reads to me an argument for self hosting, maybe
by bradfa 21d ago
As long as you are constantly diligent in staying on top of what each provider is doing that may impact you.
It reads to me an argument for self hosting, maybe a less capable model to deal with smaller compute resources, but when starting to use that model and inference software to build a benchmark you can easily rerun when you change things to observe the impact of the change.
Maybe that’s a similar level of diligence but they feel different to me.