LLMs can only predict the next word, I don't know if it's an advantage to use a language with provable correctness or dependent types, especially when training

LLMs can only predict the next word, I don't know if it's an advantage to use a language with provable correctness or dependent types, especially when training data is scarce.