4 ms·
It depends on how big the model is. They are using a little LLM to help correct text and that would be dreadful if it took a server round trip.
by ec109685 2y ago
It depends on how big the model is. They are using a little LLM to help correct text and that would be dreadful if it took a server round trip.