4 ms·

Yeah, lots of custom data. See https://ipinfo.io/data https://ipinfo.io/data for an overview

dougb5 11y ago
Since you are building off of GeoLite which has a ShareAlike license (http://creativecommons.org/licenses/by-sa/3.0/ http://creativecommons.org/licenses/by-sa/3.0/), does that mean you are distributing your modified database under the same terms?
- deleted 11y ago
  [deleted]
- coderholic 11y ago
  It's a good question. I've been in touch with Maxmind's legal team before and they were happy with what we were doing, but that was before we had started building out our custom data. My thoughts are: 1) We're not modifying the maxmind DB. We download their MMDB file and leave it completely untouched. Our code basically does something like this: if ip in custom_db return custom_db[ip] else return maxmind_db[ip] 2) Our database is openly available via our API. Anyone can access it without needing to signup etc. They're the principles I've been operating under, but I'm not a lawyer, and I'll definitely go consult with one to get a definitive answer on where I stand with this. If it turns out that we're not meeting the license terms then we'll certainly make whatever changes necessary to ensure we do.
lossolo 11y ago
The "Network data" is just ripe, arin etc data that is available publicly to anyone.
- coderholic 11y ago
  That's one of the raw sources that go into the network data. There's also the routing tables (without which you can't always match ASNs to netblocks), other datasets, and a bunch of custom scripts that post-process the data, performing cleanup, heuristic matching and more. And then putting it all into a data format that supports handling 250 million requests a day, and serving over 90% of them in less than 10ms.
  - lossolo 11y ago
    So you use your own BGP tables or use HE or some other service to do it for you ? 250 mil requests is just ~2800 req/s. Serving 90% of them in 10 ms using api is not really any achievement, considering what kind of data you are serving. I've worked on api with 1 bil requests a day and 97% of them are below 10 ms (And the best is that only 2 machines are needed for that).

Since you are building off of GeoLite which has a ShareAlike license (http://creativecommons.org/licenses/by-sa/3.0/ http://creativecommons.org/licenses/by-sa/3.0/), does that mean you are distributing your modified database under the same terms?

deleted 11y ago
[deleted]
coderholic 11y ago
It's a good question. I've been in touch with Maxmind's legal team before and they were happy with what we were doing, but that was before we had started building out our custom data. My thoughts are: 1) We're not modifying the maxmind DB. We download their MMDB file and leave it completely untouched. Our code basically does something like this: if ip in custom_db return custom_db[ip] else return maxmind_db[ip] 2) Our database is openly available via our API. Anyone can access it without needing to signup etc. They're the principles I've been operating under, but I'm not a lawyer, and I'll definitely go consult with one to get a definitive answer on where I stand with this. If it turns out that we're not meeting the license terms then we'll certainly make whatever changes necessary to ensure we do.

lossolo 11y ago

The "Network data" is just ripe, arin etc data that is available publicly to anyone.

coderholic 11y ago
That's one of the raw sources that go into the network data. There's also the routing tables (without which you can't always match ASNs to netblocks), other datasets, and a bunch of custom scripts that post-process the data, performing cleanup, heuristic matching and more. And then putting it all into a data format that supports handling 250 million requests a day, and serving over 90% of them in less than 10ms.
- lossolo 11y ago
  So you use your own BGP tables or use HE or some other service to do it for you ? 250 mil requests is just ~2800 req/s. Serving 90% of them in 10 ms using api is not really any achievement, considering what kind of data you are serving. I've worked on api with 1 bil requests a day and 97% of them are below 10 ms (And the best is that only 2 machines are needed for that).