5 ms·

I don't think that's a particularly honest line of thinking though. It preempts the obvious counterargument, but very weakly so. Calculators are different, but

by qsort 1y ago

I don't think that's a particularly honest line of thinking though. It preempts the obvious counterargument, but very weakly so. Calculators are different, but why? Can an ensemble of a calculator, a Prolog interpreter, Alexnet and Stockfish be considered "jagged superintelligence"? They are all clearly superhuman, and yet require human experience to be wielded effectively. I'm guilty as charged of having looked at GPT 3.5 and having thought "it's meh", but more than anything this is showing that debating words rather than the underlying capabilities is an empty discussion.

famouswaffles 1y ago
>Calculators are different, but why? Can an ensemble of a calculator, a Prolog interpreter, Alexnet and Stockfish be considered "jagged superintelligence"? Those are all different things with little to nothing to do with each other. It's like saying what if I ensemble a snake and cat ? What does that even mean ? GPT-N or whatever is a single model that can do many things, no ensembling required. That's the difference between it and a calculator or stockfish.
- AstralStorm 1y ago
  That is not true, the model is modular, thus an ensemble. Uses DallE for graphics and specialized tokenizer models for sound. If you remove those tools, or cut its access to search databases, it becomes quite less capable. A human would often still manage to do it without some data still, perhaps with less certainty, while GPT has more problems than that without others filling in the holes.
  - famouswaffles 1y ago
    >Uses DallE for graphics and specialized tokenizer models for sound. chatgpt no longer uses dalle for image generation. I don't understand your point about the tokenization. It doesn't make the model become an ensemble. It's also just beside the point. Even if you restrict the modalities to text alone, these models are still general alone in ways a calculator is not.

by qsort 1y ago

famouswaffles 1y ago

>Calculators are different, but why? Can an ensemble of a calculator, a Prolog interpreter, Alexnet and Stockfish be considered "jagged superintelligence"? Those are all different things with little to nothing to do with each other. It's like saying what if I ensemble a snake and cat ? What does that even mean ? GPT-N or whatever is a single model that can do many things, no ensembling required. That's the difference between it and a calculator or stockfish.

AstralStorm 1y ago
That is not true, the model is modular, thus an ensemble. Uses DallE for graphics and specialized tokenizer models for sound. If you remove those tools, or cut its access to search databases, it becomes quite less capable. A human would often still manage to do it without some data still, perhaps with less certainty, while GPT has more problems than that without others filling in the holes.
- famouswaffles 1y ago
  >Uses DallE for graphics and specialized tokenizer models for sound. chatgpt no longer uses dalle for image generation. I don't understand your point about the tokenization. It doesn't make the model become an ensemble. It's also just beside the point. Even if you restrict the modalities to text alone, these models are still general alone in ways a calculator is not.