3 ms·
My local newspaper's online version for years was free to use. Of course, they then added a paywall which kicks in after only two "free" articles per month. G
by dsiegel2275 4y ago
My local newspaper's online version for years was free to use. Of course, they then added a paywall which kicks in after only two "free" articles per month.
Given that I refuse to pay the $3 per month for access due to strong disagreements that I have, politically, with ownership of the newspaper, I decided to build a "paywall bypass" solution as a side project. The solution involved building a small server app that acts as a proxy between my browser and their site. It parses out the HTML representation of the articles, which their paywall script at runtime first obfuscates, then removes from the DOM. This solution, naturally, also avoids my browser loading and requesting a whole collection of third-party trackers and ads - since I'm not "rendering" their entire site, simply scraping relevant portions of the HTML.
The kicker: I pay $5 a month to host this on a DigitalOcean droplet.
I regret nothing.
- pschuegr 4y agoI admire your stubbornness. I've thought about doing something similar to parse news sites into raw content... how hard was the parsing and rendering?
- dsiegel2275 4y agoIt was shockingly easy and straightforward. And in three years of running it, I have yet to need to update it in reaction to an implementation or page structure change on their end. naywall.com