It was just a very odd decision to make. The project was billed as creating a “drop-in replacement” for the original LLaMA weights, so it’s unclear why they wou

It was just a very odd decision to make. The project was billed as creating a “drop-in replacement” for the original LLaMA weights, so it’s unclear why they would want to train the model with a different tokenizer.