3 ms·

Security of out all the domains of computing seems to me like it will be amongst the last fields to be automated away. The lack of precision in AI systems is p

Security of out all the domains of computing seems to me like it will be amongst the last fields to be automated away. The lack of precision in AI systems is pretty damning because it only takes ONE mistake to cause a breach. As others have already mentioned, AI is already extensively used in security operations. I think we will see more and more people replaced by AI who spend their days crawling through logs since it's hard to imagine something AI is better at. This is a domain of security where sheer data crunching can make up for imprecision. When it comes to things like LLMs and secure application development, AI is happy to suggest code that it got from a stackoverflow thread with massive and glaring security holes. Or code which is not inherently insecure, but assumes the systems it connects to can be trusted, which is a dangerous assumption. It isn't even close to comprehending the broader social, business, and security context of an organisation and achieving a balance of those concerns. It needs an IMMENSE amount of handholding from a true expert to be useful. By the time AI can replace cybersecurity experts, it will be able to replace human IT and development experts altogether.

c048 3y ago
How about AI being an additional security layer? Say I would look at security from a different point of view, namely behavior pattern matching. If your traceability is high enough, a trained AI might be able to sniff out potential breaches immediately. The same is true for cheating in AI. Once we've trained models and games log enough metrics, I'm quite sure that AI can sniff out cheaters with high precision by behavior alone. Even if they don't use aimbots, AI should be able to sniff out wallhackers or other minor cheaters by simply analyzing how players are observing their surroundings.
- hsbauauvhabzb 3y ago
  There are plenty of tools that do ‘ai’ in security. Anomaly detection can be valuable, but for the most part they’re snake oil.
- seabass-labrax 3y ago
  You might well be right about AI's efficacy at detecting video game cheaters, but I've never understood why this is an issue. If cheating can't be easily distinguished by a human from skilled (but legitimate) play, why would such cheating reduce the enjoyment of the game? With a well-functioning match-making lobby, the cheaters would simply class themselves out of all the normal games and end up playing other cheaters, leaving legitimate players well alone. As someone who enjoys casually playing online games, many of which have little or no cheating detection, I genuinely don't understand why many think the problem deserves stacks of 20GB VRAM cards running AI models, let alone rootkits client-side. Please enlighten me :)

c048 3y ago

How about AI being an additional security layer? Say I would look at security from a different point of view, namely behavior pattern matching. If your traceability is high enough, a trained AI might be able to sniff out potential breaches immediately. The same is true for cheating in AI. Once we've trained models and games log enough metrics, I'm quite sure that AI can sniff out cheaters with high precision by behavior alone. Even if they don't use aimbots, AI should be able to sniff out wallhackers or other minor cheaters by simply analyzing how players are observing their surroundings.

hsbauauvhabzb 3y ago
There are plenty of tools that do ‘ai’ in security. Anomaly detection can be valuable, but for the most part they’re snake oil.
seabass-labrax 3y ago
You might well be right about AI's efficacy at detecting video game cheaters, but I've never understood why this is an issue. If cheating can't be easily distinguished by a human from skilled (but legitimate) play, why would such cheating reduce the enjoyment of the game? With a well-functioning match-making lobby, the cheaters would simply class themselves out of all the normal games and end up playing other cheaters, leaving legitimate players well alone. As someone who enjoys casually playing online games, many of which have little or no cheating detection, I genuinely don't understand why many think the problem deserves stacks of 20GB VRAM cards running AI models, let alone rootkits client-side. Please enlighten me :)