If you are OK with roll again then you can just have a cylinder-ish shaped dice where numbers are on the sides (so it is N-edge polygon instead of a circle) and

If you are OK with roll again then you can just have a cylinder-ish shaped dice where numbers are on the sides (so it is N-edge polygon instead of a circle) and top and bottom is marked as "roll again" even better, you can round the top and bottom. Either by semi spheres or pointy like a pencil tip. Then chances of "roll again" hitting would be really low!