4 ms·
That's a really recent paper. Do you actually keep up to date with everything? How do you find the time?
by kristopolous 3y ago
That's a really recent paper. Do you actually keep up to date with everything? How do you find the time?
- totoglazer 3y agoNot to denigrate the person you’re responding to, but to add some context: That paper got a decent amount of attention already. Probably one of the more notable in the literature over the last month. Plus compared to the past year everything is slow now.
- visarga 3y agoJust reading a couple papers every day, the most interesting ones, and following up on reddit and twitter to get notified what people are talking about. And I am directly interested in long-context LLMs for a work related task. I have also been dabbling with neural nets (pre-transformer), especially LSTM which have a "residual" connection, the one I was mentioning. That makes gradients better behaved. Schmidhuber tech.