3 ms·
Queries seem to be pretty heavyweight because on AI Dungeon there is noticeable lag and sometimes it times out. It will be interesting to see how OpenAI prices
by skybrian 6y ago
Queries seem to be pretty heavyweight because on AI Dungeon there is noticeable lag and sometimes it times out. It will be interesting to see how OpenAI prices queries.
Google has managed to get machine translation to work offline on cell phones [1] so it seems plausible that some very compressed model might eventually work if they made the effort, but it probably wouldn't be the same.
[1] https://support.google.com/translate/answer/6142473?co=GENIE.Platform%3DAndroid&hl=en https://support.google.com/translate/answer/6142473?co=GENIE...