4 ms·
Maybe people will start running local models on their phones to avoid this, i've seen a couple of apps for android that do just that.
by Muhammad523 7mo ago
Maybe people will start running local models on their phones to avoid this, i've seen a couple of apps for android that do just that.
- amarant 7mo agoMy rtx5090 does not have enough vram to run a large model at usable speeds. What kind of phone do you have that outperforms my gaming rig?
- anshumankmr 7mo agohttps://apps.apple.com/us/app/locally-ai-local-ai-chat/id6741426692 https://apps.apple.com/us/app/locally-ai-local-ai-chat/id674... these are not powerful models but if compute on the iPhone increases, it may be plausible.
- EFreethought 7mo agoMaybe there will be models-as-a-service, MaaS as well. Pay extra for no ads. Like Proton Mail vs Gmail.