4 ms·
I think we're in the beginning of a warm winter. The funding is there but we're letting hype drive everything and not calling out the con artists. The problem
by godelski 3y ago
I think we're in the beginning of a warm winter.
The funding is there but we're letting hype drive everything and not calling out the con artists.
The problem is we've had recent great success but still don't know how to get to AGI. But because we're afraid of winter we're not willing to try new things. We want to only compare to sota and think it's fair to compare a new method with a handful of papers to the status quo. That's not how the S-curves of technology work. Sure, maybe things don't scale but that doesn't mean they don't have merit or can't scale if someone finds some modification.
The problem is we treat research like products, not academic work. You need to produce everything from hard core theory to robust products to have an effective chain. But we seem hyper focused on the middle area. And for some reason people think products can be placing a nice interface around research code. There's still a lot of work you need to do and all those models can be optimized. They absolutely do not have optimal hyper parameters or even parameters.