3 ms·
I suspect that they were using classical ML techniques, and a lot of traditional scientific computing techniques, but not a lot of deep learning, given how new
by fnbr 9y ago
I suspect that they were using classical ML techniques, and a lot of traditional scientific computing techniques, but not a lot of deep learning, given how new it is, and how slow government operates.
It's also not clear how a lot of the classical ML can be translated into a DL setting- a lot of graph analysis [1] is traditionally solved using matrix factorisation, for instance, which doesn't directly translate into deep learning. You can find different ways of doing it with DL, but it's not as transferable.
[1]: e.g. analysing an individual's social graph. I believe that Facebook uses a lot of classical techniques, like PCA. I've heard that Facebook has been pouring a lot of money into research that uses DL on arbitrary graphs.
- deepnotderp 9y agoRandom walks or spectral embeddings for graph convolutions already work exceptionally well.
- visarga 9y agoI've been following the domain of Graph Neural Nets with interest for a while. It seems to be picking up.
- danmaz74 9y ago> how slow government operates Government pioneered, or pushed contractors to pioneer, lots of technologies - just think about NASA. I'm pretty sure that, with their budget, the NSA is at the forefront of technologies that can be used in their field, but they obviously don't want to disclose what they do. Adopting a publicly available technology shouldn't be difficult at all.