3 ms·

I look at in the following way: understanding something by abstracting over lower level details doesn't mean the abstraction is how things actually work, the ex

I look at in the following way: understanding something by abstracting over lower level details doesn't mean the abstraction is how things actually work, the extra layer of abstraction may just be a nice way of thinking about something that makes thinking about it easier. But in the end the true mechanics are the sum of low level details. In general abstractions are not perfect, hence 'leaky abstractions'.

calf 4y ago
That's a philosophical argument, whereas people are implicitly denying that ChatGPT can have higher level abstraction at all as if it were valid to claim that Stroustrup's contribution to C++ was ultimately just a way to write a lot of assembly code, so let's forever only think in assembly terms. (As a separate tangent, I don't accept the philosophy that abstractions are merely human niceties or conveniences. They are information theoretic models of reality and can be tested and validated, after all, even the bottom level of reality is an abstraction. The very argument used to deny the primacy of abstractions itself requires conceptual abstractions, leading to a circular logic. But then, I'm not a philosopher so what do I know.)
- feanaro 4y ago
  (Poster from several comments upstream.) I'm not trying to deny the ChatGPT model has formed higher-level abstractions; in fact, I think it's fairly obvious you have to do this in some way in order to obtain such a level of breadth and accuracy of response. However those abstractions and their formation still boil down to statistics. This is similar to how e.g. mechanics of macroscopic bodies still boils down and reduces to quantum field theory and gravity, even though that's not the best way to explain or understand what's going on.