Wasnt it the other way around? I thought the valley of the kings/queens/workers were after the pyramids and due to the fact the pyramids drew too much attention

Wasnt it the other way around? I thought the valley of the kings/queens/workers were after the pyramids and due to the fact the pyramids drew too much attention to the site from graverobbers (tomb-raiders? :P).