3 ms·
Can't wait to find out what the heck he's been working on in AI! Seems to me like he would be best at scaling to extreme model size and making efficient use of
by modeless 4y ago
Can't wait to find out what the heck he's been working on in AI! Seems to me like he would be best at scaling to extreme model size and making efficient use of available hardware, but it would be too expensive to keep up with the corporate labs as an independent researcher. And from what I've seen before it seems like his opinion is that scale might not be required.
- gwern 4y agoFWIW, Lex is good about including a ToC, and when you have that, you can use the dropdown menu to open up YouTube's neural-net-generated transcripts (which are surprisingly good but also deliberately extremely literal and badly formatted) to read that instead of spending 5 hours listening to it. (This is what I did to quickly check out his comments on Gato etc.)
- modeless 4y agoOh, I'm going to listen to the whole thing for sure. John Carmack's interests line up very well with mine.