ali_chherawalla

5 ms·

1. 31.▲
   by ali_chherawalla 8mo ago

   I don't really do TTS right now, but i allow for STT using whisper. TTS is part of the backlog and I should be adding it soon
2. 32.▲
   by ali_chherawalla 8mo ago

   with the metal infra its actually quite good. Agreed you can't run really large models, but inference is very fast and TTFT is very low. It's a beautiful experience
3. 33.▲
   by ali_chherawalla 8mo ago

   awesome
4. 34.▲
   by ali_chherawalla 8mo ago

   thank you, appreciate it!
5. 35.▲
   by ali_chherawalla 8mo ago

   i don't think they do image gen etc? You can almost think of Off Grid like an on-device assistant. It'll handle everything like vision, and attachments too. We're still early stages and lots of optimizations to do, but we&#x2
6. 36.▲
   by ali_chherawalla 8mo ago

   yup just updated. Thanks!
7. 37.▲
   by ali_chherawalla 8mo ago

   I agree. I mean mobile devices have only been getting more and more powerful.
8. 38.▲
   by ali_chherawalla 8mo ago

   I actually think you should give it a spin. IMO you don't need claude level performance for a lot of day to day tasks. Qwen3 8B, or even 4B quantized is actually quite good. Take a look at it. You can offload to the GPU as well so it s
9. 39.▲
   by ali_chherawalla 8mo ago

   LM Studio does it well. Along with being a system integrator for SD, and text models I've tried to create a very good chat experience. So theres some sauce over there with Prompt enhancements, Auto detection of images, English Transcri
10. 40.▲
    by ali_chherawalla 8mo ago

    hey, just pushed a fix for it here: https://github.com/alichherawalla/off-grid-mobile/releases/t... Thanks for spotting and reporting this.
11. 41.▲
    by ali_chherawalla 8mo ago

    I've added a section for recommended models. So basically you can chose from there. I'd recommend going for any quantized 1B parameter model. So you can look at llama 3.2 1B, gemma3 1B, qwen3 VL 2B (if you'd like vision) Appr
12. 42.▲
    by ali_chherawalla 8mo ago

    wow. thank you
13. 43.▲
    by ali_chherawalla 8mo ago

    sorry about that one. I'm taking a look and fixing it right away
14. 44.▲
    by ali_chherawalla 8mo ago

    ok, let me figure that one out.
15. 45.▲
    by ali_chherawalla 8mo ago

    thank you!
16. 46.▲
    by ali_chherawalla 8mo ago

    yup, just took a look at that and fixed it. My bad!
17. 47.▲
    by ali_chherawalla 8mo ago

    yeah thats right. for now for iOS you'll actually have to pod install etc. Thanks for pointing this out
18. 48.▲
    by ali_chherawalla 8mo ago

    LM Studio solves for it pretty well I think. It doesn't do image gen etc though
19. 49.▲
    by ali_chherawalla 8mo ago

    Thank you!
20. 50.▲
    by ali_chherawalla 8mo ago

    hey, yes. thanks just pushed that fix out
21. 51.▲
    Show HN: Off Grid – Run AI text, image gen, vision offline on your phone(github.com)

    124 points by ali_chherawalla 8mo ago|66 comments