7 ms·
Applying machine learning to Infosec
- astazangasta 10y agoAs machines (computers) grow more sophisticated and start to resemble living things in their complexity, we're going to have to start dramatically improving their regenerative capacity and their ability to self-diagnose. Else the future will be littered with sad, broken robots. Training a machine implies some sort of evolutionary model (a training set describes a fitness landscape). Maybe this will work (doubtful, across such a large and variable surface), but how about thinking about this on a fundamental design level? How does a computer know it is working properly?
- digi_owl 10y ago> How does a computer know it is working properly? That is the crux of the issue. Any command that potential malware may give, may also be given legitimately. How one tell those two apart is context. And context is a hard subject even for humans. Even biology can't get it straight. After all, some of our most resilient diseases exploit the normal signals of cells for their own purposes.
- newman314 10y agoMy biggest fear is about failure modes. It seems that there is a great deal of trust being placed in ML output but what happens when it is wrong? Remember it's not infallible and should not be treated as such.
- pilooch 10y agoMachine learning is pervasive in the new products targeted at cybersecurity and infosec. From malware to anomaly detection among billions of logs, it's been part of the demand of my customers for at least four years now. Most of the largest companies are already running and testing a series of novel proprietary or custom in-house systems. The main differences with straight 'supervised' machine learning are the lack of labels, and the unreal volume of data (cheaply produced by machines, in machine time, we're talking microseconds to milliseconds here). So unsupervised learning is king in this domain, and often security operators have to keep an eye on and interpret the results. Another difference with other fields is that datasets are rare, mostly because of privacy as the logs can be very revealing. For this reason the market exhibits a lock that cannot be overcome by everyone I believe. Basically, you sort of need to be in the place already. Here is a recent very high level survey on the topic (a TC report, not that bad for once), https://techcrunch.com/2016/07/01/exploiting-machine-learning-in-cybersecurity/ https://techcrunch.com/2016/07/01/exploiting-machine-learnin... Here are two of our own Open Source tooling we use the most in application: - very efficient C++ map-reduce feature generation for logs (for ML and analytics): https://github.com/soprasteria/cybersecurity-miw https://github.com/soprasteria/cybersecurity-miw - machine learning / deep learning server: https://github.com/beniz/deepdetect https://github.com/beniz/deepdetect The ML cybersecurity + infosec field is still young, but moving very fast, a lot of new startups and (somewhat opaque) products.
- kriro 10y agoYeah my initial reaction was...wait a second ML is used in info sec. The most obvious examples are intrusion detection and general network analysis. A less glamorous example is pretty much every spam filter (which also filters fishing stuff and is thus very much infosec-relevant). I think false positives are a huge problem in the info sec context and less so in other domains. To give a made up example let's say you have ML-based intrusion detection that is hotwired to some sysadmin pager. Even if your false positive rate is fairly low (at acceptable levels in other domains) with the sheer amount of data a bunch of sysadmin calls will be triggered in sum. That is a huge human factor risk as it most likely will result in teaching admins to ignore certain alerts....which of course opens up the interesting attack vector of understanding/"reversing" the ML and triggering false positives a bunch of times until you want to attack through a channel that will trigger a similar response. Regarding the available data sets: I suppose honeypots/-nets could be created for the purpose of gathering some data sets.
- mafribe 10y agoIs there any evidence that this works in the sense of foiling sophisticated attacks?
- pilooch 10y agoAFAIK not really. Detecting C&C is not that easy in unsupervised settings. The MIT paper (link in the TC article) makes claims, but this is mostly PR. There are some reports from Google as well that you may find around, and at least at the time (few years back) they make the same observation we do with my coworkers: the rate of false positive remains high, and thus it is the job of trained security operators to spot the sophisticated attacks. Empowering the operators with more data mining tools is a good step not yet fulfilled I believe.
- hannob 10y agoIf you ask "Is there any evidence for ..." for so-called IT security products then the answer is practically always "No".
- Razengan 10y ago
- ThePhysicist 10y agoCapturing data flows and applying machine learning to them seems to be one of the hottest topics in the infosec community right now, so I would not agree that hardly anyone is doing this.
- netman21 10y agoAgree. The original article seems like it was written ten years ago. In infosec the industry is usually a decade ahead of academe.
- ntoshev 10y agoIt's not just security - I'd expect cache eviction algorithms, schedulers, constraint solvers and many others to also benefit from ML. Anything dealing with hairy problems.
- BrainInAJar 10y agoZFS uses a sort of machine learning for cache eviction ( https://en.wikipedia.org/wiki/Adaptive_replacement_cache https://en.wikipedia.org/wiki/Adaptive_replacement_cache )
- code_research 10y agoalso some interesting things here: http://www.mlsec.org/ http://www.mlsec.org/