4 ms·
Why do you have the intuition that a dense embedding space could preserve full semantic meaning? From what I understand from embeddings is that they are inheren
by tinco 3y ago
Why do you have the intuition that a dense embedding space could preserve full semantic meaning? From what I understand from embeddings is that they are inherently lossy. At least with a textual summary you could have an agent verify the summary actually accurately represents the information that it's meant to summarize.
- chefandy 3y agoFrom a technical perspective, sure: it's clear why it functions like that, and there's no technical reason it shouldn't. From a user interface perspective— likely what most people would judge with intuition— that doesn't matter. Processes that mimick familiar interaction patterns cause dissonance when they don't match our mental model of those interactions, and familiar conversation is about as familiar as you get. People we interact with know the things we explicitly tell them or guide them through figuring out, and people intuitively interact with these applications as they would with people because they've deliberately adopted the voice of an individual person. Additionally, for SaaS products, we're used to them maintaining state automatically. (As annoying as our input can be, this is why dev teams that try to solve problems for non-dev users have designers.)