For point 1, he gets into that more later in the video - e.g. specifically on counting, and about how/when to have models invoke tools instead of doing math the

For point 1, he gets into that more later in the video - e.g. specifically on counting, and about how/when to have models invoke tools instead of doing math themselves, etc. Also for the second point, check later in the video when he talks about RL and (simulated) RLHF - he gets into the feedback loops of models training each other and the collapse that follows.