Yes, but people had way more children. E.g my grand-grandparents had many kids, and counting only surviving ones is still 3x more than my grandparents. Combined

Yes, but people had way more children. E.g my grand-grandparents had many kids, and counting only surviving ones is still 3x more than my grandparents. Combined with much earlier parenthood, humans were "diffusing" their genes way faster than we do before dying earlier.