Not really. The point of an exam is to assess whether or not the student has learned the material. That an LLM can answer all the questions in 2024 is not real

Not really. The point of an exam is to assess whether or not the student has learned the material. That an LLM can answer all the questions in 2024 is not really all that much different from how it was circa 1980 when probably every integral on my calculus exam was in a table of integrals that I could buy at the college bookstore. It's just one more thing to add to the list of things that you need to prevent students from using during the exam. In 1980 that included that table of integrals on calculus exam. In 2024 it needs to include LLMs.