4 ms·
It's super intelligent but it can't be bothered to run tests unless specifically told to?
by suddenlybananas 8mo ago
It's super intelligent but it can't be bothered to run tests unless specifically told to?
- simonw 8mo agoPersonally I prefer my agents not to run random commands on my machine without me telling them to first. Imagine you just cloned some random project from GitHub and fired up Claude Code in that folder, but it turned out to be malicious and running 'npm test' stole all your files.
- suddenlybananas 8mo agoIf it's super intelligent, surely it could glance at tests before running them and figure whether it was malicious or not.
- simonw 8mo agoTests have dependencies. Crawling all of those dependencies to check for malicious code could require inspecting millions of lines of code, if you could even obtain the code. It's also beginning to sound like needing to solve the halting problem.
- suddenlybananas 8mo agoCome on man. You're being unserious here.
- simonw 8mo agoI'm really not. You're the one arguing about a "super intelligent" strawman.
- suddenlybananas 8mo agoLook, I know you have a lot invested in this project but I don't see why you think it is somehow unreasonable to expect an AI agent to run tests in a repository. You don't need super intelligence for that.
- simonw 8mo agoOf course I went agents to run tests in a repository - I do that all the time. I don't want the agent to run tests in a new repository until I've given it the go-ahead to do that.