3 ms·
"TensorFlow is an Open Source Software Library for Machine Intelligence" and then later "TensorFlow™ is an open source software library for numerical computatio
by andyjohnson0 11y ago
"TensorFlow is an Open Source Software Library for Machine Intelligence" and then later "TensorFlow™ is an open source software library for numerical computation using data flow graphs."
So it seems to be a dataflow computation library that is being used for AI/learning. Since I know almost nothing about either, I'm wondering if this (dataflow) approach has other applications unrelated to deep learning. Any comments?
Also, i wonder if this could be implemented in hardware - say on a FPGA?
- varelse 11y agoFPGAs are not measuring up to GPUs yet for these tasks. There's too much floating-point math (and yes, Altera is addressing this) for forward prediction, and way too much intermediate state to save for training (GPU memory controllers are 'da bomb for this). Finally, OpenCL compilation time on FPGAs is measured in hours as compared to seconds for GPUs. That said, address all of the above and maybe NVIDIA's stock won't hit 50 next year.
- Sanddancer 11y agoThere are a few people that seem to be working with integer-based deep learning and FPGAs, and even though they're at the beginning of research, things are looking pretty promising. Here's a paper that was released earlier this year that seems to show that at least some algorithms can see a big benefit from FPGAs http://arxiv.org/pdf/1502.02551v1.pdf http://arxiv.org/pdf/1502.02551v1.pdf .
- dharma1 11y agodid you see this? http://arxiv.org/pdf/1510.03009v1.pdf http://arxiv.org/pdf/1510.03009v1.pdf
- nickpsecurity 11y agoNow THAT has some potential. Both for FPGA's and SIMD/MIMD architectures. Thanks for the link.