4 ms·
That is very handy.
by moonka 9y ago
That is very handy.
- stanislavb 9y agoAlthough it didn't work as I expected.
- mxpxrocks10 9y agoHey, we're still kind of new and kicking the tires. Any UX feedback or data feedback is appreciated!
- regecks 9y agoIt's pretty much missing or empty data for the entire .au TLD (e.g. even google.com.au is not present). Living here, I know that their whois server rate limits heavily and the ccTLD zonefile is not available, so I'm guessing those are probably contributing reasons. Do you guys do any crawling at all? I think this is a fantastic concept though. Knowing that whois database and zonefile access is often protected for commercial motivations, it really irks me. Open it all up.
- mxpxrocks10 9y agoright now we're getting .au domains from Open Crawl. It's tricky because the zone file is not available like you mentioned. If anyone has any ideas on how to get more .au domains, we'll gladly implement.
- jlgaddis 9y agoCT logs come to mind, if you aren't using them already. DNS queries, if you have access to recursive resolvers.
- mxpxrocks10 9y agowe're using CT logs for getting hostnames (you can see it at the top of the page of any domain). We have a great recursive resolver source but haven't been able to integrate it into the data pipeline yet. thanks for the note and ideas!
- hughesey 9y agoThere's some reverse engineered zone files for a lot of cctlds at http://viewdns.info/data/ http://viewdns.info/data/.
- mxpxrocks10 9y agowoot- glad you like it so far. Any actionable feedback greatly appreciated.
- moonka 9y agoIt worked exactly as I hoped. I couldn't figure out why some domains I were expecting to show up weren't, but searching by email reminded me that I need up update some of my whois info due to a name change.
- mxpxrocks10 9y agoawesome! any feedback or ideas are appreciated, thanks for trying it out.