7 ms·
Oh, somehow I've missed that one. Thanks. Agreed about numerous scenarios. Personally I think there is value in managing the models since getting the multiple
by twelfthnight 5y ago
Oh, somehow I've missed that one. Thanks. Agreed about numerous scenarios. Personally I think there is value in managing the models since getting the multiple T/GPUs and setting up REST apis is not trivial. Serverless style GPU rental is a little tricky right now in my experience. But, HuggingFace is doing something similar and the moat isn't too wide.