3 ms·
lxml provides a module to perform html diffs mainly looking at the content rather than markup. It's not perfect but most of the times works. http://lxml.de/api
by zlagen 10y ago
lxml provides a module to perform html diffs mainly looking at the content rather than markup. It's not perfect but most of the times works.
http://lxml.de/api/lxml.html.diff-module.html http://lxml.de/api/lxml.html.diff-module.html
For Go I don't know any.
When I was working on a project like this another issue that I found regularly is that there are regions of the page(counters, advertising, etc.) that change all the time too but they are part of the content. For this I would make several requests to the page and find the regions that would change in every request and disregard them when doing the diff.