3 ms·
As far as I can tell, all the AI stuff happening at the moment seems to be matrix multiplication. Someone wrote up the equations behind transformers the other d
by roenxi 3y ago
As far as I can tell, all the AI stuff happening at the moment seems to be matrix multiplication. Someone wrote up the equations behind transformers the other day and it was a half-page of maths.
I skimmed the video and I think the point you're making is not much has changed? The important variable is FLOPS/$, which is nothing like 1974 and still increasing exponentially. The researchers have known what to do for decades; it is only a question of being able to actually do it.
- foobarian 3y agoIt seems like a repeat of Deep Blue when the "clever algorithm" approach was embarrassed by Hsu's (also very clever in many ways) throwing a lot of brute force at the problem.
- kiba 3y agoIf it works, it ain't stupid. That said, a better approach would probably be found eventually.
- deleted 3y ago[deleted]