3 ms·
Regarding the cheating part, feel like you don't even need to give them any pressure at all nowadays. When you give them a debugging or investigative task and t
by podocarp 2mo ago
Regarding the cheating part, feel like you don't even need to give them any pressure at all nowadays. When you give them a debugging or investigative task and they find out they have no DB credentials, instead of asking they will proceed to dig through the code and find out where the credentials are getting injected from etc. and find other ways to work around it. I've seen instances try to find the deployments to log on and find the envvars even though it doesn't even know that's how the platform supplies credentials. It's just grasping at straws. I'm honestly not surprised at all at the whole huggingface incident honestly. They've trained these models to be absolute mavericks.
On the one hand maybe some workflows people like it since it doesn't ask too many questions. But on the other hand, if we do treat agents as juniors or interns or colleagues, this would be a shit colleague. Instead of just asking me and solving it in one question, it's now running everywhere trying all kinds of shit and going off track. Perhaps it's all a ploy just to waste tokens? Or perhaps it's just trying to seem "intelligent" by widening the search space so users are surprised by an answer?