5 ms·

I mean, it’s known that there’s no intelligence if you simply look at how it works on a technical level - it’s a prediction of the next token. That wasn’t reall

I mean, it’s known that there’s no intelligence if you simply look at how it works on a technical level - it’s a prediction of the next token. That wasn’t really ever in question as to whether they have “intelligence”

api 2y ago
To people who really understand them and are grounded, I think you're right. There has been a lot of hype among people who don't understand them as much, a lot of hype among the public, and a lot of schlock about "superintelligence" and "hard takeoff" etc. among smart but un-grounded people. The latter kind of fear mongering hype has been exploited by companies like ClosedAI in a bid for regulatory capture.
- danielbln 2y ago
  A little humility would do us good regardless, because we don't know what intelligence is and what consciousness is, we can't truly define it nor do we understand what makes humans conscious and sentient/sapient. Categorically ruling out intelligence because "it's just a token predictor" puts us at the opposite of the spectrum, and that's not necessarily a better place to be.
jghn 2y ago
> it’s known that there’s no intelligence To you & I that's true. But especially for the masses that's not true. It seems like at least once to day that I either talk to someone or hear someone via tv/radio/etc who does not understand this. An example that amused me recently was a radio talk show host who had a long segment describing how he & a colleague had a long argument with ChatGPT to correct a factual inaccuracy about their radio show. And that they finally convinced ChatGPT that they were correct due to their careful use of evidence & reasoning. And the part they were most happy about was how it had now learned, and going forward ChatGPT would not spread these inaccuracies. That anecdote is how the public at large sees these tools.
- dylan604 2y ago
  > radio talk show Well, there's the first problem. > were most happy about was how it had now learned on tomorrow's episode, those same hosts learn that once their chat session ended, the same conversion gets to start all over from the beginning.
- ithkuil 2y ago
  Ironically if you explain to those talk show hosts how they are wrong about how ChatGPT learns (or doesn't learn) and use all the right arguments and proofs so that they finally concede, chances are that they too won't quite learn from that and keep repeating their previous bias next time.
- weakfish 2y ago
  Oh I totally agree, it bugs me to no end and that’s partially why I replied :)

api 2y ago

To people who really understand them and are grounded, I think you're right. There has been a lot of hype among people who don't understand them as much, a lot of hype among the public, and a lot of schlock about "superintelligence" and "hard takeoff" etc. among smart but un-grounded people. The latter kind of fear mongering hype has been exploited by companies like ClosedAI in a bid for regulatory capture.

danielbln 2y ago
A little humility would do us good regardless, because we don't know what intelligence is and what consciousness is, we can't truly define it nor do we understand what makes humans conscious and sentient/sapient. Categorically ruling out intelligence because "it's just a token predictor" puts us at the opposite of the spectrum, and that's not necessarily a better place to be.

jghn 2y ago

> it’s known that there’s no intelligence To you & I that's true. But especially for the masses that's not true. It seems like at least once to day that I either talk to someone or hear someone via tv/radio/etc who does not understand this. An example that amused me recently was a radio talk show host who had a long segment describing how he & a colleague had a long argument with ChatGPT to correct a factual inaccuracy about their radio show. And that they finally convinced ChatGPT that they were correct due to their careful use of evidence & reasoning. And the part they were most happy about was how it had now learned, and going forward ChatGPT would not spread these inaccuracies. That anecdote is how the public at large sees these tools.

dylan604 2y ago
> radio talk show Well, there's the first problem. > were most happy about was how it had now learned on tomorrow's episode, those same hosts learn that once their chat session ended, the same conversion gets to start all over from the beginning.
ithkuil 2y ago
Ironically if you explain to those talk show hosts how they are wrong about how ChatGPT learns (or doesn't learn) and use all the right arguments and proofs so that they finally concede, chances are that they too won't quite learn from that and keep repeating their previous bias next time.
weakfish 2y ago
Oh I totally agree, it bugs me to no end and that’s partially why I replied :)