jancurn

22 ms·

91.
A step-by-step guide how to scrape Hacker News(support.apifier.com)
2 points by jancurn 10y ago|0 comments
92.
by jancurn 11y ago
Thank you, we didn't draw it ourselves, but our friend is a great artist :) Yes, we got other advice too, primarily about funding and dealing with investors, but there's only so much you can squeeze into 1-2 hours.
93.
by jancurn 11y ago
I can't speak for YC in any way, but I can quote from http://fellowship.ycombinator.com/faq/ : "We'll consider anything we can imagine becoming a very significant company."
94.
by jancurn 11y ago
I think around 1/3 of companies in our batch were remote, but as far as I know, now it's almost entirely remote to accommodate more companies.
95.
Our Experience of the Inaugural Y Combinator Fellowship(blog.apifier.com)
89 points by jancurn 11y ago|13 comments
96.
Node.js commit: remove use of profanity in source(github.com)
1 points by jancurn 11y ago|0 comments
97.
by jancurn 11y ago
We're still here :) - at the moment we don't store the HTML content of the visited pages (except of the last one), so the only way to determine if something changed is to run the 'pageFunction' on each page again and com
98.
by jancurn 11y ago
morph.io is a great tool but it requires a non-trivial setup on your machine in order to get things running. We wanted to enable people to create scrapers with no prerequisites.
99.
by jancurn 11y ago
Currently, there is no way to distinguish traffic from our crawlers, but of course, let us know at support@apifier.com and we will blacklist your websites from our crawlers.
100.
by jancurn 11y ago
Cool, if things go well, we'll be hiring soon :)
101.
by jancurn 11y ago
You're right that most of the time you don't need to use JavaScript. But look at Google Groups for example - there is an infinite scroll to get all the topics, posts are also loaded dynamically, so you have to wait some time to ge
102.
by jancurn 11y ago
You could definitely do that, but then you might also need to: - implement a mechanism to find and click active page elements, track the browser actions - recompile PhantomJS to support POST requests - implement a page queue with checks for
103.
by jancurn 11y ago
Many thanks! You're absolutely right, we'll publish the price ASAP and also provide some long-term guarantee for users who will depend on our service. BTW do you think pricing per GB downloaded is reasonable or would you prefer so
104.
by jancurn 11y ago
Great to hear that, let us know if we can help in any way!
105.
by jancurn 11y ago
Thank you! The user JavaScript code runs in the context of the web pages in the same restricted environment as normal web page's JavaScript. Also, the crawling processes are sandboxed.
106.
by jancurn 11y ago
I forgot to add: when you reach 1 GB we'll get in touch with you.
107.
by jancurn 11y ago
TBH we don't have the pricing defined yet, because we don't know what will be our server costs. In a few days we will know more and put up the prices.
108.
by jancurn 11y ago
Thank you! The crawler is currently based on PhantomJS, there is a pool of worker nodes that distribute the crawling to more machines. We use Node.js + MongoDB backend and Meteor for front-end.
109.
by jancurn 11y ago
Hello HN! Today we’re launching what we were building for the past couple of months. Apifier is a hosted web crawler for developers that enables them to extract data from any website using a few simple lines of JavaScript. We built it becau
110.
Show HN: Apifier – hosted web crawler for developers(apifier.com)
101 points by jancurn 11y ago|35 comments
111.
by jancurn 12y ago
Many thanks for your advice, this was the first thing I tried, unfortunately without any success...
112.
How a bug in Dropbox permanently deleted my 8000 photos(medium.com)
206 points by jancurn 12y ago|141 comments
113.
Obituary for software patents(economist.com)
2 points by jancurn 13y ago|0 comments
114.
by jancurn 14y ago
I've had also quite strange experience when departing from the Ben Gurion airport in Tel Aviv two months ago. Neglecting the fact I got a very thorough security check for no apparent reason, have been asked questions like "Did you like it i
115.
The Parallel Entrepreneur(seanblanchfield.com)
1 points by jancurn 15y ago|0 comments