4 ms·
Ask HN: Any search engine creating expert here to answer my questions for $?
We can chat on https://helpouts.google.com
I will pay you for your time through Google Helpouts..
Please send me private message quoting your fees per minute.
testingbackupsoftwares gmail
I am a student so I think I can pay for some of your lunches and may be even dinners.
Thanks a million.
........My questions are:
Is it possible to build a stealth search engine (web crawling not web scraping) to target just one website online, without them knowing, and how i.e. coding skills and anonymity required?
The website I am keeping tabs on has a new web page for each new product promotion , and each new page has a dynamic url (i.e. the URL contains a query with '?')
So I wonder if it is at all possible to build a search engine / web crawler to keep up to date with it.
In other words, I want to collect the subdomain URLs on a given website, and only those URLs that contain a certain word/phrase
Please advise on how to stay in stealth mode.
Please enlighten.
Thanks a million.
- infocollector 13y agoThis could be illegal, beware!
- goughgough 13y agoThis is hilarious. What is so illegal about these questions? Oh, I forgot, I work for NSA/CIA/FBI/..... Beware.
- DigitalSea 13y agoGood luck. I think I answered a question you posted on Quora recently asking the same questions. I did respond with some advice, but I wouldn't feel confident with you paying me in return for expert advice as search engines and scraping aren't really my foray.
- goughgough 13y agoIf you are Dwayne or Abdulaziz at http://www.quora.com/Web-Crawling/Is-it-possible-to-build-a-stealth-search-engine-web-crawling-not-web-scraping-to-target-just-one-website-online-without-them-knowing-and-what-coding-skills-or-anonymity-would-be-required http://www.quora.com/Web-Crawling/Is-it-possible-to-build-a-... I want to thank you.