You can use a browser automation library for rendering JS + interaction (like click collapse button) and then use this library to extract the HTML after interac

You can use a browser automation library for rendering JS + interaction (like click collapse button) and then use this library to extract the HTML after interaction. Here is an example of using a AI browser automation library with prompt to interact (but you can also use playwright if you know the exact element to interact) https://github.com/lightfeed/extractor?tab=readme-ov-file#using-with-browser-agent https://github.com/lightfeed/extractor?tab=readme-ov-file#us...