3 ms·
How the fck are things advancing so fast? Is it about to level off …or extend to new domains? What’s a comparable set of technical advances?
by dr_dshiv 4y ago
How the fck are things advancing so fast? Is it about to level off …or extend to new domains? What’s a comparable set of technical advances?
- dqpb 4y agoThis video by Juergen Schmidhuber discusses the acceleration of AI progress: https://youtu.be/pGftUCTqaGg https://youtu.be/pGftUCTqaGg
- astrange 4y agoBigger model = better because a lot of performance at this task is memorization or the “lottery ticket hypothesis”. An impressive advance would be a small model that’s capable of working from an external memory rather than memorizing it.