4 ms·

anyone know what is the best open source model that allows commercial use and can run locally on an iphone?

• mandelken 3y ago
  Mistral 7B is pretty good and the instruct v0.2 runs on my iPhone through MLC Chat. However, the ChatGPT4 app is much better in usability: better model, multi-modal with text/vision/speech and better UI.
  • hackernewds 3y ago
    gpt 4 allows commercial use?
    • satvikpendem 3y ago
      Why wouldn't it? They sell the API for a reason.
    • WhitneyLand 3y ago
      Yes and no. You can use it commercially but there are some restrictions, including some of a competitive nature, like using the output to train new LLMs. This is the restriction that Bytedance (Tiktok) was recently banned for violating.
• BrutalCoding 3y ago
  I’ve made an example app for a Flutter plugin I created that can do this. Open-source, runs natively on all major platforms. I shared videos showing it on my iPad Mini, Pixel 7, iPhone 12, Surface Pro (Win 10 & Ubuntu Jellyfish) and Macs (Intel & M archs). By all means, it’s not a finished app. I simply wanted to use on-device AI stuff in Flutter so I started with porting over llama.cpp, and later on I’ll tinker with porting over whatever is the state of the art (whisper.cpp, bark.cpp etc). Repo: https://github.com/BrutalCoding/aub.ai https://github.com/BrutalCoding/aub.ai For any of your Apple devices, use this: https://testflight.apple.com/join/XuTpIgyY https://testflight.apple.com/join/XuTpIgyY App is compatible with any GGUF files, but it must be in the ChatML prompt format otherwise the chat UI/bubbles probably gets funky. I haven’t made it customizable yet, after all - it’s just an example app of the plugin. But I am actively working on it to nail my vision. Cheers, Daniel