4 ms·

This sounds like a very good idea, but I'm having trouble making it work. For example, let's say I want to save a great website which will probably disappear so

by amenod 8y ago

This sounds like a very good idea, but I'm having trouble making it work. For example, let's say I want to save a great website which will probably disappear soon (https://launchaco.com https://launchaco.com). I run `echo https://launchaco.com https://launchaco.com | ./archive` and then...? The generated index.html doesn't load css and js files. Or is this more for static content? Is there some tool that would allow one to make a copy of a modern SPA? Is that even possible? EDIT: I'm sad to see launchaco.com go, it would be a perfect tool for a project I'm working on. I don't mind paying, but I gather this is not possible anymore, and anyway, it might take some time for me to have everything ready...

WrtCdEvrydy 8y ago
Damn, this actually looks nice. I wonder if we can archive.
gwern 8y ago
> The generated index.html doesn't load css and js files. Or is this more for static content? Why doesn't it do that? I thought that was the point of using Chrome as a headless browser to load all the dynamic elements into a final DOM so they could then be captured & serialized out: "ArchiveBox works by rendering the pages in a headless browser, then saving all the requests and fully loaded pages in multiple redundant common formats (HTML, PDF, PNG, WARC) that will last long after the original content dissapears off the internet."
- nikisweeting 8y ago
  It does that, it's possible it just broke on the page he tried. It doesn't work perfectly on 100% of pages which is why it saves as PDF, screenshot, and other methods as a fallback.
deleted 8y ago
[deleted]
narag 8y ago
Is there some tool that would allow one to make a copy of a modern SPA? If the interesting content is inside a database at the backend, copying the interface is not enough. You also want the database.
- nikisweeting 8y ago
  ArchiveBox is going to save all requests and responses with pywb in proxy mode, so it includes any data from the database that was needed to render the page.

by amenod 8y ago

WrtCdEvrydy 8y ago

Damn, this actually looks nice. I wonder if we can archive.

gwern 8y ago

> The generated index.html doesn't load css and js files. Or is this more for static content? Why doesn't it do that? I thought that was the point of using Chrome as a headless browser to load all the dynamic elements into a final DOM so they could then be captured & serialized out: "ArchiveBox works by rendering the pages in a headless browser, then saving all the requests and fully loaded pages in multiple redundant common formats (HTML, PDF, PNG, WARC) that will last long after the original content dissapears off the internet."

nikisweeting 8y ago
It does that, it's possible it just broke on the page he tried. It doesn't work perfectly on 100% of pages which is why it saves as PDF, screenshot, and other methods as a fallback.

deleted 8y ago

[deleted]

narag 8y ago

Is there some tool that would allow one to make a copy of a modern SPA? If the interesting content is inside a database at the backend, copying the interface is not enough. You also want the database.

nikisweeting 8y ago
ArchiveBox is going to save all requests and responses with pywb in proxy mode, so it includes any data from the database that was needed to render the page.