3 ms·
> Yes I still vibe unit test and integration test, False sense of security. What's stopping the agents from doing an elaborate form of "Assert.IsTrue(true)" in
by netdevphoenix 29d ago
> Yes I still vibe unit test and integration test,
False sense of security. What's stopping the agents from doing an elaborate form of "Assert.IsTrue(true)" in some/most/all of the tests since you are vibing it and not reviewing it?
- lxgr 29d agoIf you're working with agents that severely misaligned you'll probably have issues way beyond fake tests.
- netdevphoenix 29d agoIt seems to me that chances of misalignment are a function of accumulated usage time. Eventually, it will happen.
- deleted 29d ago[deleted]
- orwin 29d agoExactly what happened in a PR from a few months ago, from the beginning it felt wrong, pytest was moved from the dev group to the main import section. Then imported in our models. To add ignores everywhere.
- preg_match 29d agoAgreed. If you don’t want to read the code that’s fine, but you have to read the testing code. Otherwise you have no idea what’s going on.
- netdevphoenix 27d agoYeah, you have to have some level of involvement. It's crazy that we are actually talking of 100% dev involvement to literally 0% involvement.