ospider

12 ms·

91.
by ospider 7y ago
Things are a little different here in China. The government just published a law that if you scraping traffic is more the one third of the total traffic of a website, it is considered illegal.
92.
by ospider 7y ago
Yes, since each of Chinese android vendors(Huawei/Xiaomi/Oppo/Oneplus...) has their own "Google Play" alternative in China. Their are plenty of tools for uploading apps to each of these markets.
93.
by ospider 8y ago
brilliant analogy
94.
by ospider 8y ago
I think the OP is saying that a good manager does not treat employees as resources
95.
by ospider 8y ago
Exactly. In real world, most projects need a mixed architecture.
96.
by ospider 8y ago
The owner of this website (deliveroo.engineering) has banned the country or region your IP address is in (CN) from accessing this website. huh
97.
by ospider 8y ago
There is another scenario, I submitted a Pull Request to a OSS project, the authors discussed it and rejected it and then implemented it in the exact same way as I did. That was hurtful.
98.
by ospider 8y ago
definitely Sophie's World .
99.
by ospider 8y ago
Most of Titles We Read on the Internet are Clickbait Like This One. The title does caught my eyes, but I didn't see anything useful in the discussion. I'm actually training myself avoiding this kind of articles. Clearly, "mos
100.
by ospider 8y ago
I have switched to Firefox two month ago. The only feature I missed about "show initiator in devtools network panel"[1] 1. https://github.com/jingjingke/crontab.git
101.
by ospider 8y ago
You mean cash?
102.
by ospider 8y ago
That sounds like goroutine, you can call any regular sync function with `go fn()`, and a goroutine is started.
103.
by ospider 8y ago
It would be nice to see it in a table
104.
by ospider 8y ago
Actually, the profit plan has been going very well and straight forward - ADs.
105.
by ospider 8y ago
No offense, but I was thinking that does good manger always lead to a better result? I mean, as far as the CEO concerned, good mangers should give better results.
106.
by ospider 8y ago
As far as the history shows, China has never been an immigration country, unless the home of immigrates were conquered by China.
107.
by ospider 8y ago
Why do I would like to submit to these directories if my startup were not for developers? AFAIK, this would only attracts more copycats than real users.
108.
by ospider 8y ago
> Isn’t the lack of compiler type checking making it difficult? There is type hinting. > And what about lack of access modifiers? There is @property decorators
109.
by ospider 8y ago
250000000 / (3600 * 40) / 20 = 86 86 pages per machine is not very performant at all, just very simple parallelism will do.
110.
by ospider 8y ago
wasm is not just about using other languages in the browser, it allows you to reuse many different libs that are well-written in other languages. For example, in my company, we compiled ffmpeg in wasm so that people can actually edit videos
111.
by ospider 8y ago
Besides the technical details between vgo and dep. The go team just announced and accepted its own proposal, completely ignoring the community's solutions, dep was even called the official experiment, which is sad.
112.
by ospider 8y ago
`dep` is actually a good tool and suppose to be the official tool. But out of no reason, `vgo` came out and said to be deprecating `dep`. I don't really understand how the Go team make decisions.
113.
by ospider 8y ago
Paring "csv" and "obj" format is also difficult. They both have "simple" specs, but neither of them has a standard spec.
114.
by ospider 8y ago
I do web crawling for a living, the method mentioned in the article does not work for most sites
115.
by ospider 9y ago
Which means at some point, we have to switch from dep to vgo. although the transaction could be smooth, but the methodology behind it must have changed, and that would not be a smooth transaction for our mindset.
116.
by ospider 9y ago
Totally agree, a good manager should do all the bragging so that "you" could really do the things that benefits yourself and the company.
117.
by ospider 9y ago
I don't get the point, it's just a nicer alternative to beautifulsoup. Html pages are always changing, instead of writing the parsing logic in code, I think we should put xpath or css expressions in some config files.
118.
by ospider 9y ago
This feature should be easily implemented by a extension for Google Chrome using the webRequest API
119.
by ospider 9y ago
It has always been scheduling and anti-blocking
120.
by ospider 9y ago
I wrote web scrapers as my daily work. For so many times, people(coworkers) just came to me saying "Hi, can you scrape this site for me?", however, what they want might just be `extracting` some table out of a login-protected page

More ›