2 ms·
Awesome to see this published. Work on transformer alternatives, especially parallelizable ones like this, is incredibly important - it would suck if we get su
by whimsicalism 3y ago
Awesome to see this published.
Work on transformer alternatives, especially parallelizable ones like this, is incredibly important - it would suck if we get sucked down a local optima in architecture without actually looking at nearby viable alternatives.
- pico_creator 3y agoYup. I’m all here for infinite scaling of context size