3 ms·

Seems like you can't run it locally. I don't like my code being sent to a third party, especially when my employer may not agree with it. I also edit secret/en

Seems like you can't run it locally. I don't like my code being sent to a third party, especially when my employer may not agree with it. I also edit secret/env files in my IDE, so for instance, a private key or API key could get sent, right? I hope there will be a local option later.

_flux 2y ago
They use backend configurable at environment variable ZED_PREDICT_EDITS_URL https://github.com/zed-industries/zed/blob/2f734cbd5e24526479bfbe4e411dfe097afae9da/crates/zeta/src/zeta.rs#L744C67-L744C88 https://github.com/zed-industries/zed/blob/2f734cbd5e2452647... , but I don't know if the /predict_edits/v2 endpoint is something some projects provide or not. At least the model is available and interacting with it seems simple, so it's probably quite realistic to have an open/locally runnable version of it. The model isn't very big.
- levzzz 2y ago
  yeah, i'd like to be able to run it locally. it should fit well onto my 12gb gpu
  - mbitsnbites 2y ago
    The model is based on Qwen2.5-Coder-7b it seems. I currently run some quantized variant of Qwen2.5-Coder-7b locally with llama.cpp and it fits nicely in the 8GB VRAM of my Radeon 7600 (with excellent performance BTW), so it looks like it should be perfectly possible. I would also only use Zeta locally.
    - jbk 2y ago
      Are you happy with the speed with your 8GB GPU?
mikaylamaki 2y ago
> a private key or API key could get sent, right? You can disable this feature on a per-file basis, here’s the relevant setting: https://github.com/zed-industries/zed/blob/39c9b1f170cd640cd93ad91ebd1915c3003907a8/assets/settings/default.json#L785 https://github.com/zed-industries/zed/blob/39c9b1f170cd640cd...
- yencabulator 2y ago
  Sending files to a remote server is never something that should need to be disabled, this must be an opt-in or it's time for a fork.
  - 85392_school 2y ago
    It is opt in. You have to manually sign in to Zed and enable the feature.
  - mikaylamaki 2y ago
    Agreed. The predict edit feature needs to be actively enabled before it'll do anything. And once it's enabled, it won't send up your private keys or environment variables. If their filename matches a glob in this list, or a list you configure.

_flux 2y ago

They use backend configurable at environment variable ZED_PREDICT_EDITS_URL https://github.com/zed-industries/zed/blob/2f734cbd5e24526479bfbe4e411dfe097afae9da/crates/zeta/src/zeta.rs#L744C67-L744C88 https://github.com/zed-industries/zed/blob/2f734cbd5e2452647... , but I don't know if the /predict_edits/v2 endpoint is something some projects provide or not. At least the model is available and interacting with it seems simple, so it's probably quite realistic to have an open/locally runnable version of it. The model isn't very big.

levzzz 2y ago
yeah, i'd like to be able to run it locally. it should fit well onto my 12gb gpu
- mbitsnbites 2y ago
  The model is based on Qwen2.5-Coder-7b it seems. I currently run some quantized variant of Qwen2.5-Coder-7b locally with llama.cpp and it fits nicely in the 8GB VRAM of my Radeon 7600 (with excellent performance BTW), so it looks like it should be perfectly possible. I would also only use Zeta locally.
  - jbk 2y ago
    Are you happy with the speed with your 8GB GPU?

mikaylamaki 2y ago

> a private key or API key could get sent, right? You can disable this feature on a per-file basis, here’s the relevant setting: https://github.com/zed-industries/zed/blob/39c9b1f170cd640cd93ad91ebd1915c3003907a8/assets/settings/default.json#L785 https://github.com/zed-industries/zed/blob/39c9b1f170cd640cd...

yencabulator 2y ago
Sending files to a remote server is never something that should need to be disabled, this must be an opt-in or it's time for a fork.
- 85392_school 2y ago
  It is opt in. You have to manually sign in to Zed and enable the feature.
- mikaylamaki 2y ago
  Agreed. The predict edit feature needs to be actively enabled before it'll do anything. And once it's enabled, it won't send up your private keys or environment variables. If their filename matches a glob in this list, or a list you configure.