You realize that consent in this case is just what we refer to as "authorization", right? And it is absolutely within any website operator's rights to only auth

You realize that consent in this case is just what we refer to as "authorization", right? And it is absolutely within any website operator's rights to only authorize their site for certain users and for certain purposes. Websites are not "public resources"; site operators just mostly choose to allow the general public to access them. There's no legal requirement that they do so. If you want anti-discrimination laws that apply to businesses to also cover bots, that is well outside of current law. A site operator can absolutely morally and legally decide they do not allow non-human visitors, just like a store can prohibit pets.