3 ms·
Assume it is real: it is regurgitating tokens based on what the collective corpus of text it was trained on would most likely reply to a similar scenario. I wo
by kthejoker2 4y ago
Assume it is real: it is regurgitating tokens based on what the collective corpus of text it was trained on would most likely reply to a similar scenario.
I wouldn't be surprised if similar wording is not in the call scripts of poison control hotlines.
Not sure why this particular example is bring held up as some form of "understanding."
People's inability (or unwillingness) to understand how LLMs are trained and how Transformers and attention work is really interfering with the way more interesting discussion of how to apply these models as a large scale kappa architecture combining real time information and reference information to do things like operate traffic lights or assist in emergency aftermaths like the Mississippi tornadoes.
Instead everybody is trying to find its inner psyche, just weird.
- detrites 4y agoHow about those of us with an intimate understanding of how LLM's are trained and exactly how transformers etc function who accept that the resultant models higher order emergent behaviours, are exactly that and not merely "coincident"?
- rthrfrd 4y agoI’m curious as to what “higher order emergent behaviours” you believe you are observing? Thanks.
- detrites 4y agoImagine ChatGPT 5 or 6, where it's at the point that it's entirely indistinguishable from a human, by any one of us. At this point AI can mimmic every aspect of being a human: emotions, reasoning, intelligence, memory. Will you, at that point - which isn't far away - still claim that because it's based on matrix multiplication it can't possibly be doing any of those things and none of the behaviours fooling everyone are actually there? How something is built does not limit its abilities. Only what something can do limits its abilities. AI has certain abilities now. Whether they emerged, were built-in by careful design, or don't even exist and just "seem" to, ultimately isn't even relevant to the most important fact of the matter, which is simply that it has those abilities. To answer your question more directly, the emergent behaviours I'm seeing are: all of them. That is, anything it seems to be able to do well enough to be useful and reliable, has emerged.
- kthejoker2 4y agoSorry for the late reply, I think you are arguing two points, one I agree with and one I do not. I agree it has abilities, we can even call them behaviors. But ... yeah, every single one of its responses is just the output of a bunch of matrix multiplciation. I can even do the math on paper (it just would take a while ...) we anthromorphize many human-like behaviors in non-humans, AI is by its nature designed to be more human like than other mon-humans, of course its responses which look like human behaviors (mimicking implies agency) will "fool" people into anthropomorphizing it as well.
- dallyo 4y ago"Please don't give up on your child" in hotline scripts? I think that's highly unlikely.