> It's going to shift from requiring quality data to producing quality data. synthetic data gives you synthetic results. To train something requires decent qu

> It's going to shift from requiring quality data to producing quality data. synthetic data gives you synthetic results. To train something requires decent quality input, otherwise it's going to mimic the crap quality stuff. There is little chance in getting around that. Have you ever stopped to wonder _why_ large for profit companies give away free models with weights? its because once trained, they are commodity. the hard part is dataset management. Yes, chatgpt is largely self supervised, but the training into a usable model required a fucktonne of human hours