5 ms·
Tabby infers on the gpu and is slow, I can only imagine how slow truepilot is on the cpu. If people want auto complete, it needs to be super fast. For slow inf
by ranguna 4y ago
Tabby infers on the gpu and is slow, I can only imagine how slow truepilot is on the cpu.
If people want auto complete, it needs to be super fast. For slow inference, a better application would be a chatbot that reads your code and answers questions, like cody from sourcegraph.