5 ms·
My predictions: 1. state-space models make transformer based models obsolete 2. Cuda killer gets set loose by AMD 3. The world's first successful head transp
by ottaborra 3y ago
My predictions:
1. state-space models make transformer based models obsolete
2. Cuda killer gets set loose by AMD
3. The world's first successful head transplant takes place
4. Children of Dune gets greenlit
5. Lex Friedman retires from interviewing
- solomatov 3y ago> state-space models make transformer based models obsolete We will see whether they work on a large scale pretty soon. I hope they will, but they might not be. There're models which might outperform more advanced models on the smaller scale, and I haven't heard how Mamba performs on GPT scale.
- p-e-w 3y agoThere's no such thing as a "head transplant". The person receiving the transplant is the one whose head it is. The transplant they receive is the rest of the body. Therefore, "full body transplant" is a more accurate term.
- RugnirViking 3y agoRespectfully, I don't think you or anyone else alive right now actually knows how this would go down. The amount of interactions between organs, central nervous system, endocrine system, and brain means I'm not sure anybody involved would remain "them"
- nebula8804 3y agoWhy do you think Lex will retire? Did he indicate something?
- bilsbie 3y agoState space?
- nextos 3y agoSee https://srush.github.io/annotated-s4 https://srush.github.io/annotated-s4. I also think state-space models will make a comeback.
- runjake 3y agoWhich Lex? Friedman or Fridman? They both do podcasts and interviews.