2 ms·

Any way to run this on Gemma 4 only? If there was a “local” mode, I would seriously think about installing this.

robot_jesus 6mo ago
Out of curiosity, why not just try it with one of the many local managers like LM Studio or Ollama or oMLX, etc? The Gemini app is kind of terrible (apart from the models) but Gemma 4 runs great locally already.
- syntaxing 6mo ago
  I run lmstudio now and it’s more like a “chat” bot. Where as Gemini app is more like an agent.
  - tuzemec 6mo ago
    You can enable the lm studio server and use any openai compatible harness to use the models that are running inside it. OpenCode, pi, even Claude and Codex...
  - solarkraft 6mo ago
    I’ve been missing agentic capabilities from almost all local LLM apps. It’s like they’re all stuck in 2023. That’s why I started using OpenCode for this. It works pretty well, the web UI comes pretty close to a general chat app. You can use folders to organize your sessions like projects (which annoyingly Gemini still doesn’t have) with files and extra instructions. It’s pretty powerful.
    - adrian_b 6mo ago
      OpenCode is one solution, but there are also several alternatives. For example pi-dev, but even Codex is open source and it should work with any locally-hosted model, e.g. by using the OpenAI-compatible API provided by llama-server. I have not used pi-dev until now, but the recent presentation of pi-dev by its developer (reported on other HN threads) has convinced me that he is among the people who can distinguish good from bad, which unfortunately cannot be said about many people creating AI applications. So I intend to switch to using pi-dev as a coding assistant for my locally-hosted models, but I do not have yet results demonstrating that this is the right choice, besides its lead developer being more trustworthy than the others.
      - solarkraft 6mo ago
        I too am interested in Pi and Codex, but haven’t seen any full-featured web UIs for them yet. Would be happy to know if there are some! One thing I’m considering (depending on how happy I am with OpenCode after trying to remove some questionable functionality it has) would be to make Pi (or Codex) speak the OpenCode protocol so that its web UI can be used with it.

Out of curiosity, why not just try it with one of the many local managers like LM Studio or Ollama or oMLX, etc? The Gemini app is kind of terrible (apart from the models) but Gemma 4 runs great locally already.

syntaxing 6mo ago
I run lmstudio now and it’s more like a “chat” bot. Where as Gemini app is more like an agent.
- tuzemec 6mo ago
  You can enable the lm studio server and use any openai compatible harness to use the models that are running inside it. OpenCode, pi, even Claude and Codex...
- solarkraft 6mo ago
  I’ve been missing agentic capabilities from almost all local LLM apps. It’s like they’re all stuck in 2023. That’s why I started using OpenCode for this. It works pretty well, the web UI comes pretty close to a general chat app. You can use folders to organize your sessions like projects (which annoyingly Gemini still doesn’t have) with files and extra instructions. It’s pretty powerful.
  - adrian_b 6mo ago
    OpenCode is one solution, but there are also several alternatives. For example pi-dev, but even Codex is open source and it should work with any locally-hosted model, e.g. by using the OpenAI-compatible API provided by llama-server. I have not used pi-dev until now, but the recent presentation of pi-dev by its developer (reported on other HN threads) has convinced me that he is among the people who can distinguish good from bad, which unfortunately cannot be said about many people creating AI applications. So I intend to switch to using pi-dev as a coding assistant for my locally-hosted models, but I do not have yet results demonstrating that this is the right choice, besides its lead developer being more trustworthy than the others.
    - solarkraft 6mo ago
      I too am interested in Pi and Codex, but haven’t seen any full-featured web UIs for them yet. Would be happy to know if there are some! One thing I’m considering (depending on how happy I am with OpenCode after trying to remove some questionable functionality it has) would be to make Pi (or Codex) speak the OpenCode protocol so that its web UI can be used with it.