Synthetic data absolutely does work well for code. While Moore's Law probably doesn't strictly apply to GPUs, it's not far off. See [1] where they find "We fin

Synthetic data absolutely does work well for code. While Moore's Law probably doesn't strictly apply to GPUs, it's not far off. See [1] where they find "We find that FLOP/s per dollar for ML GPUs double every 2.07 years (95% CI: 1.54 to 3.13 years) compared to 2.46 years for all GPUs." (Moore's law predicts doubling every 2 years) https://epochai.org/blog/trends-in-gpu-price-performance#trends-of-gpus-used-in-ml https://epochai.org/blog/trends-in-gpu-price-performance#tre...