3 ms·
This comment and many others speculate on the limits of ChatGPT based on assumptions about what ChatGPT does that are not quite accurate. In particular, ChatGPT
by CrushItNerds519 4y ago
This comment and many others speculate on the limits of ChatGPT based on assumptions about what ChatGPT does that are not quite accurate. In particular, ChatGPT does not simply output the “most semantically popular result”. That description applies only to the base model, before instruction tuning and RLHF.
As for the speculation itself, e.g., “as soon as you merge two subjects, you are right back to gambling semantics as logic”, it may be suggestive to consider that such models have learned to translate between English and French after having only trained on the two languages separately.
- gavanwilhite 4y agoThank you for this comment! I haven't spent much time learning about how ChatGPT works, but: 'ChatGPT does not simply output the “most semantically popular result”. That description applies only to the base model, before instruction tuning and RLHF.' was exactly the explanation I needed!
- thomastjeffery 4y agoMuch like ChatGPT, you seem to have comprehended the words I said, but not their meaning.
- CrushItNerds519 4y agoNope. If you were to consider carefully enough the language example that I gave, you would see that it already refutes your speculation. Another way would be to apply your argument to humans, who have managed to be useful despite having been trained only on (a broader class of) semantics (i.e., the sum of all qualia) and the logical imperfections that this entails (cf. your comments). Happy new year!