I recall reading something from one of the Xorg maintainers saying, "There's maybe three people in the entire world who really understand how X works." So that

I recall reading something from one of the Xorg maintainers saying, "There's maybe three people in the entire world who really understand how X works." So that might go some ways to explaining why building your own isn't a walk in the park.