5 ms·
Apparently TensorFlow uses Eigen (another library for Tensors) and HPTT executes up to 27.4 times faster than Eigen.
by paufernandez 9y ago
Apparently TensorFlow uses Eigen (another library for Tensors) and HPTT executes up to 27.4 times faster than Eigen.
- Langdal 9y agoNote that they only compared their solution with Eigen’s tensor transposition functionality. HPTT is not a drop-in replacement.
- wohlergehen 9y agoDoes anyone know how much time a typical TensorFlow model spends in transposition routines?
- pmalynin 9y agoNo hard numbers to present, but it would be beneficial in long-sequence LSTM networks, because TensorFlow has to do time-major <=> batch-major transposition between steps.