4 ms·
Yup, incredibly ironic actually. :) I know why that's happening, but I unfortunately can't fix it due to Rails Rumble rules. I'll be overhauling the content e
by jeremymcanally 16y ago
Yup, incredibly ironic actually. :)
I know why that's happening, but I unfortunately can't fix it due to Rails Rumble rules. I'll be overhauling the content extraction over the next little while using what I've learned from stuff you guys have submitted. Example: Did you know a lot of sites don't actually use <p> tags? Or that some sites have a metric ton of JS (many times more than the HTML in the <body>!)? It's awesome! :(
- atomical 16y agoI have been working on a similar problem and was surprised to find that there isn't a solution that can extract text perfectly (or is there?).
- jeremymcanally 16y agoUnfortunately there isn't anything near perfect as far as I've found. There are a lot of clever things you can do, but markup is incredibly hard to parse (in the "What's actually in here?" sense) and it's even harder to determine the original author's intent for elements. HTML 5 sites makes this much easier, but that's like 0.00000001% of pages on the Internet at this point. :/