4 ms·
I would very much like a local code assist tool. Assuming integration with editors is my problem, what's best in class this week if a) I have a respectable GPU
by regularfry 3y ago
I would very much like a local code assist tool. Assuming integration with editors is my problem, what's best in class this week if a) I have a respectable GPU; b) I don't, and need CPU-only?
- Filligree 3y agoNothing even comes close to copilot. I realise you said “local”, but if you insist on that you’re going to be disappointed.
- MisterAV 3y agoOn Visual Studio there's an extension (by Microsoft) called IntelliCode which is a small AI assistant that runs locally on the CPU. It doesn't come close to these new large GPU models but it's quite handy. It looks into what you're typing on the current line and the previous activity along with the current project and tries to predict the full line or even the same change on multiple lines if that makes sense.
- azhenley 3y agoWe recently published a paper on IntelliCode and share some of the usage numbers. https://austinhenley.com/pubs/Vaithilingam2023ICSE_IntelliCode.pdf https://austinhenley.com/pubs/Vaithilingam2023ICSE_IntelliCo... Disclaimer: I'm one of the co-authors.
- wsxiaoys 3y agoCheck out https://github.com/TabbyML/tabby https://github.com/TabbyML/tabby, which is fully self-hostable and comes with niche features. On M1/M2, it offers a convenient single binary deployment, thanks to Rust. You can find the latest release at https://github.com/TabbyML/tabby/releases/tag/latest https://github.com/TabbyML/tabby/releases/tag/latest (Disclaimer: I am the author)
- mormegil 3y agoI have just installed Fauxpilot <https://github.com/fauxpilot/fauxpilot https://github.com/fauxpilot/fauxpilot> (nVidia GPU-only) and it works... OK. Still evaluating and I'm basically sceptic on the whole concept, but... let's see.