What does it take these days to roll our own search engine? I’m working on a new kind of search - I’d like to create my own independent index. Bing is fine, bu

What does it take these days to roll our own search engine? I’m working on a new kind of search - I’d like to create my own independent index. Bing is fine, but restrictive. Gigablast is ok. https://search-new.herokuapp.com/ https://search-new.herokuapp.com/ Looks like the Common Crawl .WET files are about 10 TB (https://commoncrawl.org/2021/11/october-2021-crawl-archive-now-available/ https://commoncrawl.org/2021/11/october-2021-crawl-archive-n... ). Typesense recommends 3X the amount of RAM to hold the indexes. 30TB of RAM. Each TB server, what, $5k? I'm sure some pages can be reduced. Worst case, $150,000 for server costs?