But if you take a mean of those samples' means it would approach the population mean with an approximately normal distribution. Isn't that only an improvement?

But if you take a mean of those samples' means it would approach the population mean with an approximately normal distribution. Isn't that only an improvement? (Disclaimer I've only taken intro to stats at an undergrad level, exam next week)