4 ms·
I was wondering the time per step, I am aware it converges faster. Let me know when you have more results! I want to start doing things with text soon and I wo
by jorgemf 10y ago
I was wondering the time per step, I am aware it converges faster.
Let me know when you have more results! I want to start doing things with text soon and I would love to try RWA
- jostmey 10y agoThe RWA model is described in equations (7) of this paper: https://arxiv.org/pdf/1703.01253.pdf https://arxiv.org/pdf/1703.01253.pdf I think you will see that the cost per training set is just as cheap if not cheaper than a LSTM model. On my machine, the RWA model completes each training step faster than a LSTM model. I don't know if that will hold for GPUs.
- singularity2001 10y agoYes, give us wall time please