3 ms·
Right, I meant why transformers exploded over LSTM-based LMs in 2018 was because of those training issues that transformers solved. I'm excited about the next
by VHRanger 4y ago
Right, I meant why transformers exploded over LSTM-based LMs in 2018 was because of those training issues that transformers solved.
I'm excited about the next iteration of models focusing on inference. RWVK seems promising on this end. Also love the citizen science aspect of RWVK coming out.