Well the predicting tests they do would not be possible in this scenario, because they want to finetune a model against a set of data in order to make those pre

Well the predicting tests they do would not be possible in this scenario, because they want to finetune a model against a set of data in order to make those predictions, and API calls aren't differentiable -> they can't train -> they can't use it to learn to predict. So, I think they see a use case here.