3 ms·
They use backend configurable at environment variable ZED_PREDICT_EDITS_URL https://github.com/zed-industries/zed/blob/2f734cbd5e24526479bfbe4e411dfe097afae9da/
by _flux 2y ago
They use backend configurable at environment variable ZED_PREDICT_EDITS_URL https://github.com/zed-industries/zed/blob/2f734cbd5e24526479bfbe4e411dfe097afae9da/crates/zeta/src/zeta.rs#L744C67-L744C88 https://github.com/zed-industries/zed/blob/2f734cbd5e2452647... , but I don't know if the /predict_edits/v2 endpoint is something some projects provide or not.
At least the model is available and interacting with it seems simple, so it's probably quite realistic to have an open/locally runnable version of it. The model isn't very big.
- levzzz 2y agoyeah, i'd like to be able to run it locally. it should fit well onto my 12gb gpu
- mbitsnbites 2y agoThe model is based on Qwen2.5-Coder-7b it seems. I currently run some quantized variant of Qwen2.5-Coder-7b locally with llama.cpp and it fits nicely in the 8GB VRAM of my Radeon 7600 (with excellent performance BTW), so it looks like it should be perfectly possible. I would also only use Zeta locally.
- jbk 2y agoAre you happy with the speed with your 8GB GPU?