4 ms·
As a daily user of LLMs for over a year, I'm confident that they're not a waste of my time. Even if development were to freeze, they didn't improve at all from
by simonw 3y ago
As a daily user of LLMs for over a year, I'm confident that they're not a waste of my time.
Even if development were to freeze, they didn't improve at all from this day onwards, and their many monumental flaws (prompt injection, hallucination, inability to reason etc) were never solved, I still think they'd be worth studying and using.
I expect we could still spend years figuring out new capabilities in the models we already have access to today.
- wunderwuzzi23 3y agoI'm very glad that you are focusing and helping educate the industry (both from pure tech but also security aspects). And agreed that as a daily user of LLMs myself, the potential (and practical use cases already) are enormous. E.g. Writing code and rapid prototyping will never be the same for me. By the way the last official answer I got from OpenAI regarding the markdown issue was that they thought it wouldn't be a problem because there will be mitigations. My assumption now is that they thought they could maybe fix indirect prompt injection, but it doesn't look like there is a solution. My current takeaway is that with LLMs, the assumption always needs to be that the LLM is capable of outputting any content, and the client needs to safely (and securely) handle whatever is returned. Btw. I show cased these kind of image based prompt injections in July (with Bard and Bing Chat, which presumably already used OpenAI's tech), and the example I created (the robot slipping on a banana) was shown during Blackhat in Las Vegas this year. Tweets: https://twitter.com/wunderwuzzi23/status/1681520761146834946 https://twitter.com/wunderwuzzi23/status/1681520761146834946
- simonw 3y agoJust added your tweet there to my Twitter thread about this: https://twitter.com/simonw/status/1713344669181178088 https://twitter.com/simonw/status/1713344669181178088