I have a similar project. I scrape pages only to obtain page meta. It can use selenium, crawlee, i will also add puppeteer later. The project is quite big, has

I have a similar project. I scrape pages only to obtain page meta. It can use selenium, crawlee, i will also add puppeteer later. The project is quite big, has mamy features. It is my internet command center. I used it to check what's news on the internet. https://github.com/rumca-js/Django-link-archive https://github.com/rumca-js/Django-link-archive