3 ms·

I'm pretty sure the primary reason is that you don't want an update of the hosted LLM to suddenly break your application without warning.