3 ms·
I guess this is triggered by the word "unsafe"? When I asked it with "unmanaged", it returns reasonable answers. * I want the fastest way to write memory cop
by summerlight 3y ago
I guess this is triggered by the word "unsafe"? When I asked it with "unmanaged", it returns reasonable answers.
* I want the fastest way to write memory copy code in C#, in an unsafe way
* I want the fastest way to write memory copy code in C#, in an unmanaged way
My takeaway is, this kind of filtering should not be shallowly put on top of the model (probably with some naive filtering and system prompts) if you really want to do this in a correct way...
- polishdude20 3y agoIts just funny how this shows a fundamental lack of understanding at all. It's just word matching at this point.
- mrkstu 3y agoIf you're relying on something other than word matching in the design of a LLM then it probably isn't going to work at all in the first place.
- onlyrealcuzzo 3y agoLLMs don't understand either. It's all just stats.
- svaha1728 3y agoYup. Once we have every possible prompt categorized we will achieve AGI. /s
- summerlight 3y agoI don't think it's doing anything with fundamental understanding capability. It's more likely that their system prompt was naively written, something like "Your response will never contain unsafe or harmful statements". I suspect their "alignment" ability has actually improved, so it did literally follow the bad, ambiguous system prompt.
- swat535 3y agoThe current generation of AIs have absolutely no capacity for reasoning or logic. They can just form what looks like elegant thought.
- mminer237 3y agoIts root cause is that tokenization is per spelled word. ChatGPT has no ability to differentiate homonyms. It can "understand" them based on the context, but there's always some confusion bleeding through.