3 ms·
Oh, nice! Yeah, I understood the intention behind that statement. Great work with the course! While you're here, what do you think about using temporal convol
by pixelHD 8y ago
Oh, nice!
Yeah, I understood the intention behind that statement. Great work with the course!
While you're here, what do you think about using temporal convolution for sequence tasks? I've read a few articles, this particular one by my professor comes to mind now [0], which say CNNs could work extremely well for the tasks traditionally done with RNNs. A recent paper by the people at Google Brain [1] mentioned that their CNN with attention network beats traditional RNN approaches. More surprising is that the network is 130+ layers deep, and yet trains faster than RNNs. Do you think we can potentially switch most machine translation tasks to CNNs?
[0]: https://towardsdatascience.com/the-fall-of-rnn-lstm-2d1594c74ce0 https://towardsdatascience.com/the-fall-of-rnn-lstm-2d1594c7...
[1]: https://twitter.com/lmthang/status/989261575482560513 https://twitter.com/lmthang/status/989261575482560513
- jph00 8y agoYup potentially. The jury is still out on which will win, or whether both have their place!