The discussion at the end of this article starts to get to the problem with extrapolating. Llama1-65b (roughly Chinchilla optimal) and Llama2-34b used similar

The discussion at the end of this article starts to get to the problem with extrapolating. Llama1-65b (roughly Chinchilla optimal) and Llama2-34b used similar compute and although Llama2 not directly comparable is the closest comparator without extrapolating and illustrates the point.