3 ms·
I love this whole series on misconceptions! Our expectations here are very much set by human-human interactions: we expect memory, introspection, that saying a
by zamfi 2y ago
I love this whole series on misconceptions!
Our expectations here are very much set by human-human interactions: we expect memory, introspection, that saying approximately-the-same-thing will give us approximately-the-same-result, that instructions are better than examples, that politeness helps, and many more [1] -- and some of these expectations are so deeply rooted that even when we know, intellectually, that our expectations are off, it can be hard to modify our behavior.
That said, it will be super interesting to see how people's expectations shift -- and how we bring new expectations from human-AI interactions back to human-human interactions.
[1]: https://dl.acm.org/doi/pdf/10.1145/3544548.3581388 https://dl.acm.org/doi/pdf/10.1145/3544548.3581388 (open access link)
- JohnMakin 2y ago> Our expectations here are very much set by human-human interactions True, but also a healthy dose of marketing these tools as hyper-intelligent, anthropomorphizing them constantly, and hysterical claims of them being "sentient" or at least possessing a form of human intelligence by random "experts" including some commenters on this site. That's basically all you hear about when you learn about these language models, with a big emphasis on "safety" because they are ohhhh so intelligent just like us (that's sarcasm).
- zamfi 2y agoI hear you, and that certainly plays a role -- but we actually did the work in that paper months before ChatGPT was released (June-July 2022), and most of the folks who participated in our study had not heard much about LLMs at the time. (Obviously if you ran the same study today you'd get a lot more of what you describe!)