Its not wrong its an experimental observation based on systematic tests I've done. Maybe, with great strain either in quantity of training or ad hoc tweaking, t

Its not wrong its an experimental observation based on systematic tests I've done. Maybe, with great strain either in quantity of training or ad hoc tweaking, this particular low bar can be hurdled. But it is still the case in general that numeracy is not prone to naturally and unexpectedly emerge from this type of system. The extent to which that matters depends on what your goal is. If you care about results in the here and now, then random patches optimized to use cases is fine. If you care about figuring out where to look for things we can do cognitively that are not very well suited to these generator models, the surprising lack of numeracy so far is a great starting point. The next obvious question is why it takes billions to notice the numbers 1 - 10? What models wouldn't suck at that?