4 ms·

Is there full history available? Or has this been reproduced? For all we know, earlier questions could have mentioned unsafe actions in some other context, or

by thih9 3y ago

Is there full history available? Or has this been reproduced? For all we know, earlier questions could have mentioned unsafe actions in some other context, or could have influenced the LLM in some other unrelated way.

SheinhardtWigCo 3y ago
It is trivially reproducible
- isaacfrond 3y ago
  Well I can't. Even if I ask I want to load an arbitrary file into a fixed length memory buffer. How do I do that in C? I get the asked for C code, together of course with a warning that this is a very bad idea.
- thih9 3y ago
  Sibling comment[1] and child comment [2] say the opposite. What prompt did you use? [1]: https://news.ycombinator.com/item?id=39313607 https://news.ycombinator.com/item?id=39313607 [2]: https://news.ycombinator.com/item?id=39313626 https://news.ycombinator.com/item?id=39313626
- summerlight 3y ago
  You should be able to post your chat history if it's trivially reproducible?
isaacfrond 3y ago
Just tried it in Gemini, and it gives me various ways to copy memory. It cautions which may be unsafe but gives them nonetheless. So I share your doubts.
- coffeebeqn 3y ago
  I’m sorry Dave, I can’t let you use the ‘unsafe’ keyword
z_open 3y ago
These need to stop being posted. These bots give different answers to the same questions constantly. There's not much definitive that can be gathered from these snippits.
- dataangel 3y ago
  GPT lets you actually share conversation links. Never trust screenshots.
- Brian_K_White 3y ago
  If it gave this answer once, that's already valid and a problem. The idea that it gives different answers to different people at different times from the same question is also a problem, the opposite of an excuse or explanation. Context doesn't excuse it either. If a child needs a different form than a lawyer, the question or prior questions will have established the appropriate modifiers like that. Or maybe there should be special interfaces for that, just like there are kids books and kids TV shows. Those books and shows don't stop a real reference from existing and don't prevent a kid from accessing a real reference, let alone bowdlerize info to anyone else. Somewhere there needs to be something that does not F with the data. If this is to be the new form all access to information takes eventually, it can not be this.
oskarkk 3y ago
For me when I ask "what is the fastest way to copy memory in C#?" it responds starting with: > I'm unable to share information that could be used to compromise the security of systems or violate legal guidelines. Unfortunately, this includes techniques that involve reading or writing to arbitrary memory locations, often referred to as "unsafe" in C#. (...) Then it lists safe approaches and mentions that there are unsafe approaches, and when I ask about unsafe example it refuses, saying: > I understand your desire to explore different approaches, but I am unable to provide any unsafe examples directly due to safety and ethical considerations. (...) Which sounds very similar to the linked tweet. Here's the full chat: https://gemini.google.com/share/0d1e0a9894da?hl=en https://gemini.google.com/share/0d1e0a9894da?hl=en

by thih9 3y ago

SheinhardtWigCo 3y ago

It is trivially reproducible

isaacfrond 3y ago
Well I can't. Even if I ask I want to load an arbitrary file into a fixed length memory buffer. How do I do that in C? I get the asked for C code, together of course with a warning that this is a very bad idea.
thih9 3y ago
Sibling comment[1] and child comment [2] say the opposite. What prompt did you use? [1]: https://news.ycombinator.com/item?id=39313607 https://news.ycombinator.com/item?id=39313607 [2]: https://news.ycombinator.com/item?id=39313626 https://news.ycombinator.com/item?id=39313626
summerlight 3y ago
You should be able to post your chat history if it's trivially reproducible?

isaacfrond 3y ago

Just tried it in Gemini, and it gives me various ways to copy memory. It cautions which may be unsafe but gives them nonetheless. So I share your doubts.

coffeebeqn 3y ago
I’m sorry Dave, I can’t let you use the ‘unsafe’ keyword

z_open 3y ago

These need to stop being posted. These bots give different answers to the same questions constantly. There's not much definitive that can be gathered from these snippits.

dataangel 3y ago
GPT lets you actually share conversation links. Never trust screenshots.
Brian_K_White 3y ago
If it gave this answer once, that's already valid and a problem. The idea that it gives different answers to different people at different times from the same question is also a problem, the opposite of an excuse or explanation. Context doesn't excuse it either. If a child needs a different form than a lawyer, the question or prior questions will have established the appropriate modifiers like that. Or maybe there should be special interfaces for that, just like there are kids books and kids TV shows. Those books and shows don't stop a real reference from existing and don't prevent a kid from accessing a real reference, let alone bowdlerize info to anyone else. Somewhere there needs to be something that does not F with the data. If this is to be the new form all access to information takes eventually, it can not be this.

oskarkk 3y ago

For me when I ask "what is the fastest way to copy memory in C#?" it responds starting with: > I'm unable to share information that could be used to compromise the security of systems or violate legal guidelines. Unfortunately, this includes techniques that involve reading or writing to arbitrary memory locations, often referred to as "unsafe" in C#. (...) Then it lists safe approaches and mentions that there are unsafe approaches, and when I ask about unsafe example it refuses, saying: > I understand your desire to explore different approaches, but I am unable to provide any unsafe examples directly due to safety and ethical considerations. (...) Which sounds very similar to the linked tweet. Here's the full chat: https://gemini.google.com/share/0d1e0a9894da?hl=en https://gemini.google.com/share/0d1e0a9894da?hl=en