20-30% isn't modest. I think there is a big problem though, but it's that it's character level prediction. It's not obvious how generate this kind of good synt

20-30% isn't modest. I think there is a big problem though, but it's that it's character level prediction. It's not obvious how generate this kind of good synthetic data when it's to be fed to a tokenized model.