3 ms·
I wish we didn't use LLMs to create test code. Tests should be the only thing written by a human. Let the AI handle the implementation so they pass!
by tasuki 11mo ago
I wish we didn't use LLMs to create test code. Tests should be the only thing written by a human. Let the AI handle the implementation so they pass!
- lxgr 11mo agoHumans writing tests can only help against some subset of all problems that can happen with incompetent or misaligned LLMs. For example, they can game human-written and LLM-written tests just the same.
- tasuki 11mo agoNot property-based tests. Either way, the human is there to tell the machine what to do: tests are one way of expressing that.