It has to be said that the use of CFG is not free, the difference between training and inference change the sample distribution. This difference makes it easy f

It has to be said that the use of CFG is not free, the difference between training and inference change the sample distribution. This difference makes it easy for a trained eye to distinguish a SD/MJ image from a real one just from a thumbnail, compare to the text generated by ChatGPT that is pretty much indistinguishable given that there is no discrepancy between training and inference. SD had another flaw that would make the sample distribution different than the one it was trained one but it's easily fixable with new models: https://arxiv.org/abs/2305.08891 https://arxiv.org/abs/2305.08891, aka the model was never trained on pure noise and there was always a little bit of signal so the model did learn to always use the mean of x_T.