4 ms·
Is the Grok CLI a 2 terabyte install? Did Elon dropship you an 8U rack of B200s? No? Well the model weights, the GPUs, and the context obviously all have to b
by fwlr 3mo ago
Is the Grok CLI a 2 terabyte install? Did Elon dropship you an 8U rack of B200s?
No?
Well the model weights, the GPUs, and the context obviously all have to be in the same place, so “sending your project to them” is literally the only thing that could possibly happen, unless you think agents work by fucking magic.
This is the biggest case of PEBKAC in history, maybe ever.
This is the kind of confusion that Charles Babbage could not rightly comprehend, except at those politicians at least had the excuse that computers had only been invented five minutes prior.
- hosel 3mo agoYou’re telling me LLMs aren’t actually magic?
- Hamuko 3mo agoIt's fascinating how many people in this conversation think that LLMs need to have all of the files in your $CWD on the model provider's servers to be able to do anything.
- notavalleyman 3mo agoHaha so just send over your entire home directory including password managers and home videos every time you need some python code rewritten. Only a buffoon would be confused by the straightforward logic.
- fwlr 3mo agoIf you decide that your entire home directory is the project, as the OP did by setting the repo_path to ~/, then, well… I mean, if you ask me, I don’t recommend it, but it’s your computer and your free will.
- butlike 3mo agoThen that should be considered a 'nuke button' and nuke buttons don't find themselves into well-designed software for the simple fact that an end user shouldn't have to worry about shooting themselves in the foot. Again, with good software.
- fwlr 3mo agoGranted, but we’re talking about agents, which fundamentally presumes the obsolescence of concepts like “end user” and “good software”.
- dminik 3mo agoThat's not how any other coding harness/agent works. Why confidently comment on stuff you know nothing about?
- ch_sm 3mo agothat‘s … not really how it works. Agents get your code into their context via tool calls, not by uploading the entire file to a server „where the weights live and thus the code has to be too“. Small but crucial difference. Aside from that: LLM providers have to be the ones that facilitate your privacy and security by default. That‘s not on the user. They‘re tool providers and they can‘t compromise you and your org by default.
- fwlr 3mo agoWhat do you think a tool call is? What is this small but crucial difference between a `read_file` tool call and `scp`? If your contention is just that this should upload files one by one instead of all at once, what you want is for providers to facilitate the illusion of privacy.