3 ms·
Linear scaling for context is also a bit deal. Flash attention partially solved this for TF, but xLSTM seems promising!
by 3abiton 2y ago
Linear scaling for context is also a bit deal. Flash attention partially solved this for TF, but xLSTM seems promising!