zlagen

7 ms·

31.
by zlagen 9y ago
Do you need to use selenium to control Firefox in headless mode or does it have something lower level like Chrome's devtools protocol?
32.
by zlagen 9y ago
Seeking Work - Remote I'm a backend developer mainly in python. I have experience managing big databases and applying performance optimizations. I also have experience on applying web scraping at scale. Skills: - Python (Django, pyrami
33.
by zlagen 9y ago
Yes, any attacker can search for your site's DNS history and try to find the real ip there. For example you can get the history for some sites using this service: https://www.netcraft.com/ The good thing is that there&
34.
by zlagen 10y ago
I guess you could use a connection pooler like pgpool-2?
35.
by zlagen 10y ago
lxml provides a module to perform html diffs mainly looking at the content rather than markup. It's not perfect but most of the times works. http://lxml.de/api/lxml.html.diff-module.html For Go I don't know
36.
by zlagen 10y ago
This will break in a lot of pages as the html will be different on each request in most pages although the content will be the same. Perhaps it would be better to compare visible text rather than the raw html.
37.
by zlagen 10y ago
Some people may use it as free proxies for web scraping.
38.
by zlagen 10y ago
Casperjs, which runs on top of PhantomJS has been nicer to use for me. Also Nightmare( http://www.nightmarejs.org/ ). The problem I always had with PhantomJS is that it's more difficult than it should be to automatize ve
39.
by zlagen 10y ago
I'm interested in this kind of projects I have a lot of experience working with scrapers. How do you earn money from them? via affiliate sales?
40.
by zlagen 10y ago
SEEKING WORK - Remote Senior Full-stack developer strong on managing big data. I worked on a startup that extracts millions of product prices daily from many ecommerce sites. My main languages are Python and Javascript but I also have exper
41.
by zlagen 10y ago
Nomadlist: https://news.ycombinator.com/item?id=8107222
42.
by zlagen 10y ago
Here's an alternative for heuristic extraction which appears to handle more complex data: https://www.diffbot.com/
43.
by zlagen 13y ago
Nicely done!