3 ms·
Have you documented your VSCode setup somewhere? I've been looking to implement something like that. Does your setup provide next edit suggestions too?
by Balinares 11mo ago
Have you documented your VSCode setup somewhere? I've been looking to implement something like that. Does your setup provide next edit suggestions too?
- 0cf8612b2e1e 11mo agoI keep idly wondering what would be the market for a plug and play LLM runner. Some toaster sized box with the capability to run exclusively offline/local. Plug it into your network, give your primary machine the IP, and away you go. Of course, the market segment who would be most interested, probably has the expertise and funds to setup something with better horsepower than could be offered in a one size fits all solution.
- tylergetsay 11mo agoKinda like https://www.microcenter.com/site/brands/nvidia-dgx-spark.aspx https://www.microcenter.com/site/brands/nvidia-dgx-spark.asp...?
- 0cf8612b2e1e 11mo agoOoof, right idea but $4k is definitely more than I would be comfortable paying for a dedicated appliance. Still, glad to see someone is making the product.
- nyrikki 11mo agoI am working on a larger project about containers and isolation stronger than current conventions but short kata etc… But if you follow the podman instructions for cuda, the llama.cpp shows you how to use their plugin here https://github.com/ggml-org/llama.vscode https://github.com/ggml-org/llama.vscode