3 ms·
This doesn't really work with most sites anymore, does it? It can't run JavaScript (unlike headless browsers with Playwright/Puppeteer, for example), has limite
by solardev 2y ago
This doesn't really work with most sites anymore, does it? It can't run JavaScript (unlike headless browsers with Playwright/Puppeteer, for example), has limited supported for more modern protocols, etc.?
Any suggestions for an easy way to mirror modern web content, like an HTTrack for the enshittifed web?
- vekatimest 2y agoArchiveBox works decently with Javascript and uses a headless browser, can be deployed with Docker
- n3storm 2y agoWhich content/information sites dependant on javascript can be found? I always find marketing oriented or app interaction heavily using js and thus unable to archive...but otherwise...
- vekatimest 2y agoLiterally any modern social media, YouTube comments, anything using client-side rendering frameworks
- n3storm 2y agoI don't see Youtube/IG/Fb/Tiktok comments as valuable content or information, I would be surprised if somebody is treasuring such content. Maybe tweets, but APIs are available for archiving (more or less).
- RGamma 2y agomonolith can work together with headless chromium. YMMV
- superkuh 2y agoTrue. But it's more like most sites don't work anymore. They can't run without javascript and lack any content but blank pages.