I think rectangular rocks would work best here. You can lay those down as even rows and get flat walls very easily. Perhaps we don’t need to use actual rocks,

I think rectangular rocks would work best here. You can lay those down as even rows and get flat walls very easily. Perhaps we don’t need to use actual rocks, even! Dried clay can work just as well. If we put it in fire, it should become firm enough for most purposes.