They don't seem to say how large their model is? Comparing themselves to LLaMa 65b seems like a bit of a tell ... it was explicitly released as a small foundat

They don't seem to say how large their model is? Comparing themselves to LLaMa 65b seems like a bit of a tell ... it was explicitly released as a small foundational model to allow others to train and improve it. If they couldn't beat that despite more parameters / training / data then they would be effectively going backwards. They do say they trained using "thousands of H100 GPUs" which is a lot more than LLaMa 65b required.