You can get improve the low hanging fruit through brute force ... but there is a lot of low hanging fruit. Model architecture cleverness will eventually outpac

You can get improve the low hanging fruit through brute force ... but there is a lot of low hanging fruit. Model architecture cleverness will eventually outpace more GPU time, but for now the roi on GPU time is higher than clever design.