3 ms·
It's... really not what I meant. This requirement does not have to be relaxed, it doesn't exist at all. Semantic similarity in embedding space is a convenient
by gpjanik 1y ago
It's... really not what I meant. This requirement does not have to be relaxed, it doesn't exist at all.
Semantic similarity in embedding space is a convenient accident, not a design constraint. The model's real "understanding" emerges from the full forward pass, not the embedding geometry.
- prmph 1y agoI'm speaking in more in general conceptual terms, not about the specifics of LLM architecture