My understanding is that the level of trust toward the build server can change. Currently, most things are signed by F-Droid, so distributed building is harder

My understanding is that the level of trust toward the build server can change. Currently, most things are signed by F-Droid, so distributed building is harder. But later less trusted servers could build the apps and check, leading to a consensus system.