Does having the ability to compile and build it yourself allay any of those concerns? It means you no longer need to trust the infrastructure or machines being

Does having the ability to compile and build it yourself allay any of those concerns? It means you no longer need to trust the infrastructure or machines being used to create the images, just the developer through their source code which, yes, while it's a daunting task to review, it's "just" a fork of AOSP. I've been building a modified LineageOS for a while, and these posts always have me circle back around and question if I should just go back to stock, Graphene or Calyx.