From another one of his responses that he has since deleted from this thread: “Despite these challenges, researchers have found that hierarchical attention can

From another one of his responses that he has since deleted from this thread: “Despite these challenges, researchers have found that hierarchical attention can improve performance on tasks like document classification, summarization, and question answering, especially for longer texts. As of my last training cut-off in September 2021, this is an area of ongoing research and development.”