3 ms·

> let us be clear that a «Perfect transformer architecture», in order to correctly perform induction of the dataset (and «generalize over» it), must also be a "

> let us be clear that a «Perfect transformer architecture», in order to correctly perform induction of the dataset (and «generalize over» it), must also be a "perfect" reasoner. Respectfully, this is false. The easiest non-technical intuition for why this is false is because the transformer can be trained on any dataset-- if you give it a random noise dataset, it does not produce "reason" but random noise. If you give it a dataset of language full of nonsense, it will produce nonsense. Using the term "reasoning" is an inappropriate anthropomorphism of the vectorized equation y=f(mx+b), which is effectively what a transformer is. Respectfully again, it's not productive for me to argue the rest of your points because they proceed from this false premise. The thing I would encourage you to think about is the relationship between the dataset and the transformer.

mdp2021 2y ago
I never said that a transformer architecture "reasons". I said that there exists an interpretation of «generalize» that is sought and it is relevant to building a world model and that it requires reasoning. When you write about «tak[ing] a dataset that has no "world model"», that is what we normally do: we gather experience and make sense of it, and that happens through functions that can be called "reasoning" (through "intelligence" etc). We already "«create[] information from thin air»" - it's what we do. If the «Perfect transformer architecture» cannot reach the proper «world model» through its own devices, it must then be augmented with the proper modules - "Reasoning", "Intelligence" etc. The point was, "Reasoning", "Intelligence" etc. do not seem to need «self-aware sentien[ce]».
- upghost 2y ago
  I think you are making my point more eloquently than I could. A perfect transformer cannot add information to a dataset, a (self-aware, sentient) reasoning human can. Perhaps at this point we are merely speculating on an existence proof-- whether or not there exists such a dataset that contains a sufficient "world model" (for some definition of "world model"). I assert that such a dataset would necessarily include a concept of the self, otherwise the "world model" would be flawed. You seem to disagree. That's fine. My argument does not hinge strongly on whether or not sentience is required for such a world model, it is sufficient to say that no such dataset exists that will provide a transformer with sufficient information to condition weights which will have an accurate world model, sentience or not. The "self-aware sentience" bit was hyperbolic prose for the sake of the joke, but the joke is that anyone pedaling "if only I had more money for compute I could make AGI" is shilling snake oil. No amount of infinite compute can turn an incomplete dataset into anything more than an incomplete dataset, information is conserved. Hopefully that point is not too controversial.

mdp2021 2y ago

I never said that a transformer architecture "reasons". I said that there exists an interpretation of «generalize» that is sought and it is relevant to building a world model and that it requires reasoning. When you write about «tak[ing] a dataset that has no "world model"», that is what we normally do: we gather experience and make sense of it, and that happens through functions that can be called "reasoning" (through "intelligence" etc). We already "«create[] information from thin air»" - it's what we do. If the «Perfect transformer architecture» cannot reach the proper «world model» through its own devices, it must then be augmented with the proper modules - "Reasoning", "Intelligence" etc. The point was, "Reasoning", "Intelligence" etc. do not seem to need «self-aware sentien[ce]».

upghost 2y ago
I think you are making my point more eloquently than I could. A perfect transformer cannot add information to a dataset, a (self-aware, sentient) reasoning human can. Perhaps at this point we are merely speculating on an existence proof-- whether or not there exists such a dataset that contains a sufficient "world model" (for some definition of "world model"). I assert that such a dataset would necessarily include a concept of the self, otherwise the "world model" would be flawed. You seem to disagree. That's fine. My argument does not hinge strongly on whether or not sentience is required for such a world model, it is sufficient to say that no such dataset exists that will provide a transformer with sufficient information to condition weights which will have an accurate world model, sentience or not. The "self-aware sentience" bit was hyperbolic prose for the sake of the joke, but the joke is that anyone pedaling "if only I had more money for compute I could make AGI" is shilling snake oil. No amount of infinite compute can turn an incomplete dataset into anything more than an incomplete dataset, information is conserved. Hopefully that point is not too controversial.