Presumably you would only have to trust the network in full. Similar to how bitcoin operates. You might have to trust the 'tracker' to give you a legit networ

Presumably you would only have to trust the network in full. Similar to how bitcoin operates. You might have to trust the 'tracker' to give you a legit network, but once you are in the swarm, it is easy to tell if any of the nodes are lying to you.