There are some interesting ideas here. I’ve had similar thoughts. For example one of applications I work on involves interpreting a response with possibly thous

There are some interesting ideas here. I’ve had similar thoughts. For example one of applications I work on involves interpreting a response with possibly thousands of fields. It is used to answer many related questions. It has been impractical to tailor the way this data is presented to just the questions the user is interested at that moment. I think an LLM could help understand what the user is after and how to get the answer out of the pile of data in the response. Chat is pretty painful though. Maybe a suite of canned prompts with a fallback to chat could work. The idea of using an LLM to render a UI on the fly seems interesting as well. But I also imagine it’d be niche due to the cost of running an LLM. At least for the foreseeable future.