3 ms·
Just a little feedback, there's a small problem with The Economist. It just includes "get our daily newsletter" thingy. Also cool project!
by DecayingOrganic 8y ago
Just a little feedback, there's a small problem with The Economist. It just includes "get our daily newsletter" thingy. Also cool project!
- k1m 8y agoHave you got a URL I can try? This one worked: https://txtify.it/www.economist.com/news/finance-and-economics/21741563-fourth-our-series-professions-shortcomings-economists-focus-too https://txtify.it/www.economist.com/news/finance-and-economi...
- DecayingOrganic 8y agoHere is it: https://txtify.it/https://www.economist.com/news/leaders/21741547-regulators-should-squash-plans-big-telecoms-merger-america-t-mobile-and-sprint-plan https://txtify.it/https://www.economist.com/news/leaders/217... It also shows up in your example as well. Maybe you don't get bothered by it? :) Please note: the bug is inconsistent, it pops out inconsistently. Here's the part: "GET OUR DAILY NEWSLETTER Upgrade your inbox and get our Daily Dispatch and Editor's Picks."
- k1m 8y agoI thought you weren't getting the content text at all. :) Should be fixed now. We now strip that out: https://github.com/fivefilters/ftr-site-config/blob/master/economist.com.txt https://github.com/fivefilters/ftr-site-config/blob/master/e... But I don't consider that a big problem - lots of sites include things like that in their content. It's annoying, but no easy way to identify them all accurately and remove them without custom rules.
- DecayingOrganic 8y agoOh, it's certainly not a big problem, I just wanted to let you know :) liked the project by the way!
- k1m 8y agoThanks! :)