5 ms·
This. I work on projects that warrant a self hosted model to ensure nothing is leaked to the cloud. Imagine my surprise when I discovered that even though the o
by integralid 7mo ago
This. I work on projects that warrant a self hosted model to ensure nothing is leaked to the cloud. Imagine my surprise when I discovered that even though the only configured model is local, all my prompts are sent to the cloud to... generate a session title. Fortunately caught during testing phase.
- lukewarm707 7mo ago[dead]
- DrewADesign 7mo agoI’m curious if there’s a reason you’re not just coding in a container without access to the internet, or some similar setup? If I was worried about things in my dev chain accessing any cloud service, I’d be worried about IDE plugins, libraries included in imports, etc. and probably not want internet access at all.
- lukewarm707 7mo ago[dead]
- ssrshh 7mo agoHaving access to internet could be important for looking up docs and things like that.
- DrewADesign 7mo agoYeah — you can develop in a container that’s configured to only allow local access. Your machine is connected to the Internet as usual, so you can access any docs you want or whatever, but the actual execution environment running on your machine can’t. This is pretty easy to set up in Docker, for example. It’s also useful because you can have the same exact dev environment no matter what machine you’re on, OS you’re running, etc.
- jmalicki 7mo agoOk wow. I mean the default model being Grok, whatever - that everyone sets to their favorite. But the hidden use of a different model is wow.
- signal_v1 7mo ago[dead]
- andai 7mo agoIf you're using software someone else wrote, you'd have to repeat this testing phase any time an update is installed, right? (I do mean this as a general principle, but also it was pointed out elsewhere in the thread that this is a particularly "high velocity" project as far as unexpected changes go.)