5 ms·
> business person says if code is good or not How do they do this? They can't trust the tests because the tests were also developed by the LLM which is working
by discreteevent 2y ago
> business person says if code is good or not
How do they do this? They can't trust the tests because the tests were also developed by the LLM which is working from incorrect information it received in a chat with the business person.
- ben_w 2y agoThe same way they already do with humans coders whose unit tests were developed by exactly same flawed processes: Mediocrely. Sometimes the current process works, other times the planes fall out of the sky, or updates causes millions of computers to blue screen on startup at the same time. LLMs in particular, and AI in general, doesn't need to beat humans at the same tasks.