Doubtful. Everyone is so GPU starved right now that many research directions can’t even be pursued. That’s why almost everyone is basically training the same ar

Doubtful. Everyone is so GPU starved right now that many research directions can’t even be pursued. That’s why almost everyone is basically training the same architecture with minor variations. Once/if that starvation ends, research will dramatically expand.