Probably. Apple published a paper back in 2017 about improving synthetic data for the purposes of training models (though not transformers). The examples they

Probably. Apple published a paper back in 2017 about improving synthetic data for the purposes of training models (though not transformers). The examples they give are for eye and hand tracking -- which not coincidentally are used for navigating the Apple Vision Pro user interface. https://machinelearning.apple.com/research/gan https://machinelearning.apple.com/research/gan