Moore's law isn't quite beaten yet, so the (hypothetical future) RTX 5090 and 6090 is gonna be insane. Combined with software optimization and refinement of the

Moore's law isn't quite beaten yet, so the (hypothetical future) RTX 5090 and 6090 is gonna be insane. Combined with software optimization and refinement of the techniques, along with training != inference, means I think we'll see something better, runnable locally, in a couple of years. The leaps and bounds Stable Diffusion has gone is insane. Facebook's LLaMA is also seeing a similar growth from just having the model available.