The Roman housing blocks (which a quick search tells me are called 'insulae') were several stories high, up to perhaps nine stories, although the higher stories

The Roman housing blocks (which a quick search tells me are called 'insulae') were several stories high, up to perhaps nine stories, although the higher stories would have been extremely undesirable (and almost certainly poor quality), so it's not like Rome itself lacked large multi-story buildings.