All valid points that one needs to consider when writing low level code. The good thing about Rust is that you actively have to circumvent the languages safety

All valid points that one needs to consider when writing low level code. The good thing about Rust is that you actively have to circumvent the languages safety checks with unsafe code to run into those problems. And if you are using unsafe code, you should be aware of such low level considerations anyway, and would refrain from using types when not appropriate. The consistency problems you describe apply to any datastructure after all.