5 ms·

Can an LLM "discern" Pravda and Pravda?

• etiam 2y ago
  I'd say, with context, yes in principle, and without context, is there really any difference. But it does seem worrisome that we don't know to what extent they currently tend to mix up properties for different entities symbolized on the same token(s). I imagine that could put a terrible strain on the context to pull them apart, and especially if the entities actually have a fair bit in common it's easy to believe that the optimization wouldn't be able to achieve a clean separation. I haven't really worked much with LLM:s in particular though.