2 ms·
If LLM can leverage on the new efficient attention mechanism based the FFT architecture discovered by Google then FPGA can be the new hot stuff [1]: [1] The FF
by teleforce 2y ago
If LLM can leverage on the new efficient attention mechanism based the FFT architecture discovered by Google then FPGA can be the new hot stuff [1]:
[1] The FFT Strikes Back: An Efficient Alternative to Self-Attention (168 comments):
https://news.ycombinator.com/item?id=43182325 https://news.ycombinator.com/item?id=43182325