4 ms·
English version of the page: https://apps.apple.com/us/app/google-ai-edge-gallery/id6749645337 https://apps.apple.com/us/app/google-ai-edge-gallery/id67496...
by jeroenhd 7mo ago
English version of the page: https://apps.apple.com/us/app/google-ai-edge-gallery/id6749645337 https://apps.apple.com/us/app/google-ai-edge-gallery/id67496...
Also on Android: https://play.google.com/store/apps/details?id=com.google.ai.edge.gallery https://play.google.com/store/apps/details?id=com.google.ai....
It's a demo app for Google's Edge project: https://ai.google.dev/edge https://ai.google.dev/edge
- deleted 7mo ago[deleted]
- om252345 7mo agoGemma4 works really slow on my android e2b model on Samsung galaxy s21 ultra. Atleast 20-30 sec to warm up and then reply.
- satvikpendem 7mo agoNeeds a modern phone, local LLMs don't work well on older phones.
- cobicobi 7mo agoneed s24 ultra and above i think
- thepbone 7mo agoThe bigger E4B model is pretty fast on my Galaxy S21 Ultra even with thinking enabled. Maybe GPU acceleration was not enabled?
- jeroenhd 7mo agoI think there's quite the performance difference between the S21 Ultra (Snapdragon 888) and the S21 Ultra (Exynos 2100). Qualcomm has optimized libraries for running LLMs on their chips that I don't believe Samsung has bothered with.
- jeroenhd 7mo agoRunning LLMs is probably the first time I find that the SoC of that generation to lack. Even Google's underpowered Tensor CPUs make a huge difference when it comes to LLM performance. You can check your settings for GPU acceleration, it's possible that enabling that makes a big difference. From what I've found online the difference may also simply be Snapdragon versus Exynos GPU driver optimizations, in which case I don't think the performance can be fixed by anyone but Samsung. Others online seem to get decent performance out of the model on the S21 Ultra at the very least.
- ysleepy 7mo agoThe S25 (edge) runs this very well. 29 tok/s for E2B.
- shaz0x 7mo ago[dead]