3 ms·
> Do you think in 20 years that this will be impossible to do? I'm not really concerned about what happens in 10/20 years, I'm more concerned about what will h
by danShumway 4y ago
> Do you think in 20 years that this will be impossible to do?
I'm not really concerned about what happens in 10/20 years, I'm more concerned about what will happen if Microsoft launches Bing chat to the general public this year and starts wiring it up to calendar and email.
I mean, honestly, yeah, I think that probably in 10 years there will be a solution to this problem if not sooner. It might be a fiendishly complicated solution, it might involve rethinking how models are trained, it might mean fundamentally limiting them in some way when they're interacting with user prompts. But 10 years is a long time, a lot can happen.
The problem is it's not clear that anyone knows how to solve this problem today. And Microsoft is not going to wait 10 years to launch Bing chat. I don't think it's as simple as "retrain the model". And even if it was, "retrain the model" is a pretty expensive ask, I'm not sure it's sustainable to retrain the model every time a security vulnerability is found.