Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
ctoa
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
5 ms
·
31.
▲
by
ctoa
10mo ago
It's sort of an RNN, but it's also basically a transformer with shared layer weights. Each step is equivalent to one transformer layer, the computation for n steps is the same as the computation for a transformer with n layers. Th
32.
▲
by
ctoa
10mo ago
You are probably thinking of Merrill (whose work is referenced towards the end of the article).