It seems that it shouldn't matter if a robots.txt was present or not because logins were required to "scrape" the information and that implies that those accoun

It seems that it shouldn't matter if a robots.txt was present or not because logins were required to "scrape" the information and that implies that those accounts that had to login probably had to accept some sort of agreement which probably forbid this in some way.