4 ms·
What happens when the index can’t fit into memory with Typesense? Does it OOM?
by tarr11 5y ago
What happens when the index can’t fit into memory with Typesense?
Does it OOM?
- jabo 5y agoCorrect, the OS’ OOM reaper will kick-in to try and protect core OS operations. So you don’t want to let it get to that stage - you’d typically want to keep at least 15% free memory for the OS to do its thing. Commercially available RAM today goes all the way to 24TB these days, which should be sufficient for a good number of search use cases. Beyond that you’d have to shard data across multiple clusters. Similarly with Algolia, they use 128GB RAM clusters, and recommend you keep your Algolia index size below 100GB: https://www.algolia.com/doc/guides/sending-and-managing-data/prepare-your-data/in-depth/index-and-records-size-and-usage-limitations/#index-size-limits https://www.algolia.com/doc/guides/sending-and-managing-data...