3 ms·
One claim from that podcast was that the xLSTM attention mechanism is (in practical implementation) more efficient than (transformer) flash attention, and there
by RossBencina 2y ago
One claim from that podcast was that the xLSTM attention mechanism is (in practical implementation) more efficient than (transformer) flash attention, and therefore promises to significantly reduces the time/cost of test-time compute.
- korbip 2y agoTest it out here: https://github.com/NX-AI/mlstm_kernels https://github.com/NX-AI/mlstm_kernels https://huggingface.co/NX-AI/xLSTM-7b https://huggingface.co/NX-AI/xLSTM-7b