3 ms·
At a guess: assuming quality scales with size, the model in the data centre is always going to outcompete the model on the device. So in any situation where you
by flir 4y ago
At a guess: assuming quality scales with size, the model in the data centre is always going to outcompete the model on the device. So in any situation where you've got bandwidth >4800bps, why would you choose the model on the device?
- CuriouslyC 4y agoYour own fine tuning, no restrictions on output, privacy/security, and if you have a reason to produce a lot of output it'll be cheaper. Use ChatGPT if you only want to use it occasionally, you don't care about privacy/security in this context, the output restrictions don't bother you and having the best possible language model is the most important thing to you.
- zone411 4y agoRight, not sending out your text to third parties is absolutely huge for certain industries. ChatGPT has been already banned by some companies, so the issue is whether or not the language model can be used at all. I'll add the possibility of network-based service downtime to the list.