9 ms·
You can run model >100x faster in cloud compared to on device with DDR RAM. This would make up for the reception.
by YetAnotherNick 2y ago
You can run model >100x faster in cloud compared to on device with DDR RAM. This would make up for the reception.
- dagmx 2y agoAnd you can’t run the cloud model at all if you can’t talk to the cloud.
- YetAnotherNick 2y agoYes, but I can't imagine situations where I "have" to run a model when I don't have internet at that time. My life would be more affected with the rest of the internet than having to run a small stupid model locally. At the very least until the hallucination is completely solved, as I need internet to verify the models.
- dagmx 2y agoYou’re assuming the model is purely for generation though. Several of the Gemini features are lookup of things across data available to it. A lot of that data can be local to device. That is currently Apple’s path with Apple Intelligence for example.
- michaelmrose 2y agoHallucination can't be solved because bogus output is categorically the same sort of thing as useful output. It has no world model. It doesn't know truth any more than it knows bullshit just a statistical relationship between words.