3 ms·
Yes this is a good empirical study on the types of tasks that's been shown to be impossible for transformers to generalise on. With both empirical and theoreti
by shawntan 2y ago
Yes this is a good empirical study on the types of tasks that's been shown to be impossible for transformers to generalise on.
With both empirical and theoretical support I find it's pretty clear this is an obvious limitation.