I think this remains to be seen. The field is beginning to embrace Moore's law, in a way. What would take an hour to train on an A100 (not to mention an H100) w

I think this remains to be seen. The field is beginning to embrace Moore's law, in a way. What would take an hour to train on an A100 (not to mention an H100) would take like 60k hours (7 years) on a GPU from 20 years ago. The pace at which we are able to brute force things is incredible, and that's not even mentioning the actual science and ML progress happening. It might be that simple brute forcing solutions become feasible before long.