Most of the researchers outside big tech only have access to a handful of consumer GPUs at best. They are under a lot of pressure to invent efficient algorithm

Most of the researchers outside big tech only have access to a handful of consumer GPUs at best. They are under a lot of pressure to invent efficient algorithms. The cost coming down by orders of magnitude seems like a good bet.