That's how every single natural language QA system worked before LLMs. For example START https://start.csail.mit.edu/ https://start.csail.mit.edu/ works that w

That's how every single natural language QA system worked before LLMs. For example START https://start.csail.mit.edu/ https://start.csail.mit.edu/ works that way. Now LLMs can do the natural language to formal language conversion in both directions. LLMs are good at translation though not so well at exact recall. They are doing this though it goes by the name 'function calling'.