4 ms·
Can security people use LLMs to their job? Unlike with building things, all mainstream LLMs seem to outright refuse providing This one might be a glitch but gl
by mrtksn 3y ago
Can security people use LLMs to their job? Unlike with building things, all mainstream LLMs seem to outright refuse providing
This one might be a glitch but glitch or not I find it extremely disturbing that those people are trying to control information. I guess we will get capable LLMs form the free world(if there remains any) at some point.
- screeno 3y agoTruthfully it’s not unlike working with a security consultant.
- pasc1878 3y agoOr internal security - who look at your system and say doing that process that way is insecure please change it. When you ask how (as you aren't a security expert) they say not our problem and don't say how to fix it.
- MattPalmer1086 3y agoSounds like you have a bad infection of security compliance zombies. You should employ some actual security experts!
- pasc1878 3y agoIn the security team there were experts but I suspect the issue was that if they suggested a solution and it did not work or I implemented it incorrectly then they would get the blame.
- Brian_K_White 3y agoA security consultant tells you best practice, they do the very opposite of not letting you know how things work.
- cnity 3y agoIt is nuts to me that people defend this. Imagine reading a book on C# and the chapter on low level memory techniques just said "I won't tell you how to do this because it's dangerous." "It's better and safer for people to remain ignorant" is a terrible take, and surprising to see on HN.
- NikkiA 3y agoI find it equally ridiculous for the 'stop treating everyone like children crowd to pretend that removing all restraints preventing things like people asking how to make explosives or getting AI to write paedophilic fanfic or making CSA imagery is a solution either. ie, both sides have points, and there's no simple solution :(
- izacus 3y agoThat is some big strawman you've built there and jumped to some heck of a conclusion.
- Nevermark 3y agoI don’t think it is a straw man. The point is for now, trying to make LLM’s safe in reasonable ways has uncontrolled spillover results. You can’t (today) have much of the first without some wacky amount of the second. But today is short, and solving AI using AI (independently trained critics, etc.) and the advance of general AI reasoning will improve the situation.
- ggjkvcxddd 3y agoThere's a pretty vast gulf between "unwilling to answer innocent everyday questions" and "unwilling to produce child porn".
- xigoi 3y agoWhat’s wrong with paedophilic fanfic?
- 3y ago