3 ms·
I think this would be reasonably testable actually (at least in a simplified case). Teach someone two relations that aren't meaningful naturally. Say Apples ->
by godelski 3y ago
I think this would be reasonably testable actually (at least in a simplified case). Teach someone two relations that aren't meaningful naturally. Say Apples -> black holes and octopi -> industrial fan. You give them a few minutes to learn them. Then give some other unrelated tasks and say "if black holes -> apples, then what does industrial fan imply?" I feel pretty confident that humans would be able to do decently well on this task. Obviously got to account for people simply forgetting the forward relationship though.
In the non-simplified case I'd actually say that we have some natural experiments, but that might spoil this as well because you can in fact say that this is training for such invariance (which I'm unsure is problematic to my claim but pushback is definitely welcome). If we're learning history we'd often learn information such as "On December 7th 1941 Japan attacked Pearl Harbor and this was a major event that got America directly involved in WW2." But then on the test we'd see questions such as "What important event happened December 7th 1941?", "What was the date of the Pearl Harbor attack?", "What major event led to the US becoming a direct player in the war and when did this event occur?" and so on. Granted, because we do such testing I'd expect GPT to be able to reasonably answer many of these same questions but I'm very much under the impression that humans are far more robust/generalized and would quickly learn these reversals. And to stress, conditioned on knowing the forward direction to a strong degree. If you're fuzzy about the forward direction I'm not surprised if the reversal is even more fuzzy. Definitely biased. But more importantly, I do not think we have the same strong algorithmic bias in our encoding methods that transformers have. That's my main claim, just to clarify.
But I'm conjecturing a lot here. I think these are reasonable and we have some strong evidence for this. Maybe this is more situational than I'm presuming and I'm definitely working off of biased sampling. So discussion helps refine the ideas.