To my knowledge no SOTA model has been trained on a significant proportion of synthetic data, has this changed? The best examples I know of are instruction tun

To my knowledge no SOTA model has been trained on a significant proportion of synthetic data, has this changed? The best examples I know of are instruction tuning sets but that is a minute amount of data compared to the unsupervised training data.