4 ms·

Previously when you told it your favourite song (directly or indirectly) it would have outputted something like "NB: favourite song is X" and then that would be

Previously when you told it your favourite song (directly or indirectly) it would have outputted something like "NB: favourite song is X" and then that would be included in the prompt forever afterwards. Anthropic has models that can input ~75k words, so I don't think this is far fetched as a way of adding memory to LLMs.

troupo 3y ago
> Previously when you told it your favourite song (directly or indirectly) How did I tell it what my favorite song is "indirectly"? > it would have outputted something like "NB: favourite song is X" Again, how? Let's say the model is trained to add this to notes when asked directly. What exactly is "indirectly", and how will it recognize that it should add "Alice will be back from office at 5PM" and "My favorite food is sushi" and not "we order Chinese takeout on the weekends"?