Strongman: LLMs aren't a tool, they're fuzzy automation. And what keeps security problems from making it into prod in the real world? Code review, testing, st

Strongman: LLMs aren't a tool, they're fuzzy automation. And what keeps security problems from making it into prod in the real world? Code review, testing, static and dynamic code scanning, and fuzzing. Why aren't these things done? Because there isn't enough people-time and expertise. So in order for LLMs to improve security, they need to be able to improve our ability to do one of: code review, testing, static and dynamic code scanning, and fuzzing. It seems very unlikely those forms of automation won't be improved in the near future by even the dumbest form of LLMs. And if you offered CISOs a "pay to scan" service that actually worked cross-language and -platform (in contrast to most "only supported languages" scanners), they'd jump at it.