Based on a quick google search (e.g., https://stackoverflow.com/questions/46673751/nutch-vs-heritrix-vs-stormcrawler-vs-megaindex-vs-mixnode https://stackoverfl

Based on a quick google search (e.g., https://stackoverflow.com/questions/46673751/nutch-vs-heritrix-vs-stormcrawler-vs-megaindex-vs-mixnode https://stackoverflow.com/questions/46673751/nutch-vs-heritr...), their existing product appears to be a hosted solution for crawling the web. This new product sounds like it is just a query language that can be used on top of what you yourself have paid them to crawl. I don't believe they've actually crawled the whole web and are providing an interface to that. Their website says things like "the entire web" and "trillions of rows", but I'm guessing that's only true if you pay them a few million dollars to do that.