2 ms·
There might be a plateau coming but I’m not sure that will be the reason. It seems counterintuitive but there is some research suggesting that using synthetic
by zackangelo 1y ago
There might be a plateau coming but I’m not sure that will be the reason.
It seems counterintuitive but there is some research suggesting that using synthetic data might actually be productive.
- jsheard 1y agoI think there's probably a distinction to be made between deliberate, careful use of synthetic data, as opposed to blindly scraping 1PB of LLM generated SEO spam and force-feeding it into a new model. Maybe the former is useful, but the latter... probably not.