Exactly this. If you're on example.com/documents/foo and think there might be something relevant on example.com/documents/, try and gain access without coming

Exactly this. If you're on example.com/documents/foo and think there might be something relevant on example.com/documents/, try and gain access without coming across a warning or terms of service reasonably located, this is clearly acceptable. Now if example.com warns you that they consider this unauthorized action and blocks your ip... well, that changes things.