4 ms·
Can anyone compare this to Tabbyml?[0] I just set that up yesterday for emacs to check it out. The context gathering seems very interesting[1], and very vim-in
by mijoharas 2y ago
Can anyone compare this to Tabbyml?[0] I just set that up yesterday for emacs to check it out.
The context gathering seems very interesting[1], and very vim-integrated, so I'm guessing there isn't anything very similar for Tabby. I skimmed the docs and saw some stuff about context for the Tabby chat feature[2] which I'm not super interested in using even if the docs adding sounds nice, but nothing obvious for the auto completion[3].
Does anyone have more insight or info to compare the two?
As a note, I quite like that the LLM context here "follows" what you're doing. It seems like a nice idea. Does anyone know if anyone else does something similar?
[0] https://www.tabbyml.com/ https://www.tabbyml.com/
[1] https://github.com/ggerganov/llama.cpp/pull/9787#issue-2572915687 https://github.com/ggerganov/llama.cpp/pull/9787#issue-25729... "global context onwards"
[2] https://tabby.tabbyml.com/docs/administration/context/ https://tabby.tabbyml.com/docs/administration/context/
[3] https://tabby.tabbyml.com/docs/administration/code-completion/ https://tabby.tabbyml.com/docs/administration/code-completio...
- ghthor 2y agoI’ve been using Tabby happily since May 2023
- mijoharas 2y agoHave you setup the context providers, and do you find that important for getting good completions?
- mijoharas 2y agoAhhh, it seems that tabby does use RAG and context providers for the code completion. Interesting: > During LLM inference, this context is utilized for code completion Hmmm... I wonder what's better. As I'm coding I jump and search to relevant parts of the codebase to build up my own context for solving the problem, and I expect that's likely better than RAG. Llama.vim seems to follow this model, while tabby could theoretically get at things I'm not looking at/haven't looked at recently...