For a dynamic set of strings, I recommend checking the StringHashTable in ClickHouse. The basic idea is: to use a bunch of hash tables with fixed-size keys but

For a dynamic set of strings, I recommend checking the StringHashTable in ClickHouse. The basic idea is: to use a bunch of hash tables with fixed-size keys but split the strings into power-of-two size-classes. This basic idea originated in a chat and led to a PhD thesis by my friend: https://www.researchgate.net/publication/339879042_SAHA_A_String_Adaptive_Hash_Table_for_Analytical_Databases https://www.researchgate.net/publication/339879042_SAHA_A_St...