3 ms·
Is there anything preventing this algorithm (or a substantially similar one) from being used on the GPU?
by d110af5ccf 6y ago
Is there anything preventing this algorithm (or a substantially similar one) from being used on the GPU?
- 0-_-0 6y agoAfter a quick read of the paper, no. You could adopt this to the GPU (which would require the hashes work on groups of neurons instead of individuals) and might get a similar speedup. Locality sensitive hashing in fact seems like a primitive attention mechanism, with proper attention implementation you could get maybe even better results.