3 ms·
This would likely help a little bit. We've already seen LLMs improve performance on some tasks by being instructed to "think carefully" first; presumably this b
by phyzome 3y ago
This would likely help a little bit. We've already seen LLMs improve performance on some tasks by being instructed to "think carefully" first; presumably this biases it towards parts of the training set that are higher quality.
But security ultimately requires comprehension, which is not something LLMs have.
- jncfhnb 3y agoSecurity 100% does not require comprehension in the philosophical sense
- phyzome 3y agoNot sure what the philosophical sense would be. I just mean that an awful lot of people treat security as "hack on the code until it doesn't obviously break", and that's the wrong mindset for practical security.
- jncfhnb 3y agoI’m not sure what you could possibly mean by LLMs don’t have comprehension if not speaking to philosphical debates of what comprehension means. I think your point is otherwise right, but the correct answer is standard best practices which is the easiest thing for bots to do