3 ms·
Does anyone have any thoughts on privacy/safety regarding what he said about GPT memory. I had heard of prompt injection already. But, this seems different, co
by joshuajooste05 1y ago
Does anyone have any thoughts on privacy/safety regarding what he said about GPT memory.
I had heard of prompt injection already. But, this seems different, completely out of humans control. Like even when you consider web search functionality, he is actually right, more and more, users are losing control over context.
Is this dangerous atm? Do you think it will become more dangerous in the future when we chuck even more data into context?
- ActorNightly 1y agoSort of. The thing is with agentic models, you are basically entering probability space where it can do real actions in the form of http requests if the statistical output leads it to it.
- threeseed 1y agoI've had Cursor/Claude try to call rm -rf on my entire User directory before. The issue is that LLMs have no ability to organise their memory by importance. Especially as the context size gets larger. So when they are using tools they will become more dangerous over time.