Binning and averaging is a well-known technique I'd say, whether applied to PCA components or even raw distributional data sorted over some dimension. A relate

Binning and averaging is a well-known technique I'd say, whether applied to PCA components or even raw distributional data sorted over some dimension. A relatex technique that I've seen speed up retrieval tasks immensely is merging frequently co-occurring binned embeddings into new bins (similar to Byte Pair Encoding) and downweighing the resulting bins when the variance between its constituent dimensions is high. This effectively yields 'bins of interest' where documents agree on some dimension(s) while filtering out documents that contain information that is general to most.