4 ms·

Are local LLMs available on phones yet?

• CGamesPlay 3y ago
  This model came out a few days ago and runs on an iPhone. https://huggingface.co/NousResearch/Obsidian-3B-V0.5 https://huggingface.co/NousResearch/Obsidian-3B-V0.5
  • simonw 3y ago
    From their README: <|im_start|>user What is this sign about?\n<image> ### <|im_start|>assistant The sign is about bullying, and it is placed on a black background with a red background. ### Any idea how you fill out that <image> bit?
    • CGamesPlay 3y ago
      No, but the GitHub repo linked from there includes a Gradio Demo UI which has an image field, so it should be possible to reverse engineer.
• simonw 3y ago
  MLC have demos that work on iOS and Android: - https://llm.mlc.ai/#ios https://llm.mlc.ai/#ios - https://llm.mlc.ai/#android https://llm.mlc.ai/#android