2 ms·
This seems like a really useful (and obvious) feature, but I wonder if this could lead to a kind of "AI filter bubble": What if one of its memories is "this use
by lxgr 3y ago
This seems like a really useful (and obvious) feature, but I wonder if this could lead to a kind of "AI filter bubble": What if one of its memories is "this user doesn't like to be argued with; just confirm whatever they suggest"?
- blueboo 3y agoThis is an observed behaviour in large models, which tend towards “sycophancy” as they scale. https://www.anthropic.com/news/towards-understanding-sycophancy-in-language-models https://www.anthropic.com/news/towards-understanding-sycopha...
- kromem 3y agoMore "as they are fine tuned" vs "as they scale"
- hackerlight 3y agoMemories are stored as distinct blobs of text. You could probably have an offline LLM that scans each of these memories one by one (or in chunks) and determine whether it could create such issues, and then delete them in a targeted way.