6 ms·
Search Engine for Web Page Source Code with 300M Sites Indexed
- ArtWomb 8y agoOne potential use is to find signatures related to crypto miners: https://badpackets.net/how-to-find-cryptojacking-malware/ https://badpackets.net/how-to-find-cryptojacking-malware/ Crypto miners are ncreasingly using webassembly and multithreaded executables in background processes. Details in this recent report on state of browser mining: Digging Into Browser-Based Mining https://arxiv.org/pdf/1808.00811.pdf https://arxiv.org/pdf/1808.00811.pdf
- detaro 8y agoDoes the same dumb matching of things that are similar to the search query like many "normal" search engines, even when putting things in "quotes", making it useless for at least some queries :/
- roadbeats 8y agoHow did you find the pages to index ? Do you follow any link or you have a criteria ?
- ddorian43 8y agoMaybe common crawl
- scruffyherder 8y agoSo looking for the famous "OH MY GOD DOES WATCOM SUCK" from DooM, I get ONE hit and I have to pay to see it? Yeah, great. 0/10
- johndough 8y ago$49 per month?? For that price I could afford a human to search code for me.
- mynewtb 8y agoYou only need it for one hour per month?
- tehlike 8y agoYou can outsource to developing countries, clearly. https://anti-captcha.com/mainpage https://anti-captcha.com/mainpage would be an example.
- bufferoverflow 8y agoYou can do it for a lot cheaper than $49/hr. Mechanical Turk will likely get you tens of hours of work of this kind.
- newsbinator 8y agoEmailing a plain text password? A bold move...
- deleted 8y ago[deleted]
- imhoguy 8y agoWhat a gem for web sites vulnerability hunters. Listing pages using some buggy WP plugin should be trivial.
- bufferoverflow 8y agoWhich is not a bad thing. Security by obscurity is not security.
- tombrossman 8y ago> Security by obscurity is not security. Security by obscurity alone isn't security, but obfuscation is a great tool to add to your security toolbox. The concept is often derided, but it is very effective when used properly.
- panchicore3 8y agolots of results for regexing basic auth tokens.
- cutler 8y agoWith a different business model this could have been a game-changing product. Opportunity missed.
- npsomaratna 8y agoOut of curiosity, how would you suggesting monetizing this?
- Kagerjay 8y agoSame ways builtwith.com and wappylzer - Business people want to see what frameworks competitors are running - Selling data analytics to business companies - Companies who have liscened software (greensock animation, etc) and want to see if any companies are illegally using their software through CDNs.
- cutler 8y agoBetter free tier to make sure it goes viral. Even more important as it's appeal is limited to devs and marketing types. Charge corporate clients for volume and service. This could have been the Google of source code but you need to take the risks Google took in making their search engine free to the masses otherwise it remains a niche product.
- nsx147 8y agoSimilar https://nerdydata.com https://nerdydata.com
- SimeVidas 8y agoYou can’t find things like “<time” (HTML tags)?
- lucb1e 8y agoThis seemed really cool and I was going to share it in a local community, but the first search I try gets me 3 results a la "lXXX.com" or "dXXX.org" and I have to pay $49 to view the results of my first search query. Never mind.
- philipodonnell 8y agoThey don't have a very focused marketing message but I think they intend to support people who want to make websites like builtwith.com and don't want to run their own indexer. $49/month for that would be quite reasonable. I'm unaffiliated and guessing of course, but the first two features are 1M search results and an API for integrating in other websites, which would be of limited use for the average web researcher using the website frontend.
- cestith 8y agoSo is it a coincidence this is priced $10 a month less than the smallest paid Shodan license?
- nacs 8y agoThe majority of results are locked behind a paywall..