A lot of things people talk about would involve the ISP having infrastructure changes to facilitate more charges which might or might not make fiscal sense (it

A lot of things people talk about would involve the ISP having infrastructure changes to facilitate more charges which might or might not make fiscal sense (it is not that easy to prioritize Facebook) . But one thing they can practically immediately do is hose you on gaming (or VoIP, same). Whether you pay or not pay for the gaming package your routing can be changed to have more or less latency to everyone outside of the ISP network simply by putting you on more outdated sections of backhaul, worse peering links etc. I am truly afraid they can make this very bad with extremely little effort.