WebArena does this really well, called the "accessibility_tree" https://github.com/web-arena-x/webarena/blob/main/browser_env/processors.py#L47 https://github.c

WebArena does this really well, called the "accessibility_tree" https://github.com/web-arena-x/webarena/blob/main/browser_env/processors.py#L47 https://github.com/web-arena-x/webarena/blob/main/browser_en...