There are tons of hurdles. For example, many major websites will block you if you are not a crawler owned by a few companies. They have to be in Google’s index

There are tons of hurdles. For example, many major websites will block you if you are not a crawler owned by a few companies. They have to be in Google’s index to survive, but that doesn’t mean they allow everyone else to copy their content.