3 ms·
What specific hardware acceleration is possible? I think TPUs are already as good as you can get for accelerating large MLPs (half of what a LLM is). Is there t
by fnbr 4y ago
What specific hardware acceleration is possible? I think TPUs are already as good as you can get for accelerating large MLPs (half of what a LLM is). Is there that much overhead for the attention blocks?
- dylan522p 4y agoNo TPUs are getting better architecturally
- sinenomine 4y agoTPU is a pretty conservative design, there are 2x...5x speedups available with full-stack optimization, and then some.