4 ms·
>This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space Interesting. Can someone explain to me why 384 s
by ClassyJacket 3y ago
>This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space
Interesting. Can someone explain to me why 384 specifically? How did they arrive at that number?
- computerex 3y agoIt has to do with the architecture of the network used to create the embeddings. The embeddings is actually the output of the final layer of the model. The dimensionality is a function of the number of parameters in that layer. Different models/architectures will produce different dimension embeddings.
- bigbillheck 3y agoIt's not a power of two but is still a nice round number (0x180).