4 ms·
The AI runs on their cloud. It's unfortunate but the industry is only starting to catch onto on-device models language models.
by threatofrain 3y ago
The AI runs on their cloud. It's unfortunate but the industry is only starting to catch onto on-device models language models.
- helloericsf 3y agoNeed to submit your OpenAI API key to use the full service. :P
- ilaksh 3y agoIt's not a matter of "catching on". There are smaller models and they have been looking into putting useful models on device from day one. It's just the fact that the models that can currently run on a mobile device are not effective enough. It is about the most memory and compute intensive type of application ever. In particular, models that can reason or follow instructions reliably and for general purpose are too big to run quickly on mobile devices. They are putting models on phones, but they do not have general purpose assistant capabilities. This may change in the next few years though.
- swyx 3y ago> the industry is only starting to catch onto on-device models language models. i mean there are technical limitations and tradeoffs to running LLM-size models locally. doesnt help to ascribe it to lack of foresight when it is a known Hard Problem.
- coffeebeqn 3y agoIt probably wouldn’t cost $199 with a capable chip and the battery to go with that. Actually the only device with such features is a recent smartphone. Wouldn’t this be better as an app?
- stavros 3y agoIt also probably wouldn't cost "no subscription" with a cloud-based AI, so what gives?
- quickthrower2 3y agoReally, so this whole thing could be a $9.99 app on my existing phone :-). And if it is that good then I can delete all the other apps. Ah already have ChatGPT installed, that'll do :-).