3 ms·
I agree that the dataset will absolutely make it. But for the use case I'm looking at, the LLM has to be available for batch concurrent inference to be useful.
by authorfly 3y ago
I agree that the dataset will absolutely make it. But for the use case I'm looking at, the LLM has to be available for batch concurrent inference to be useful. Perhaps unlike most research on datasets, time-to-inference-completion is important. But at the same time I appreciate your answer in the context of how you could be burned anyway by OpenAI say revoking access, and that you are saying the dataset allows model/freedom from the platform of OpenAI as such.