3 ms·

I tried something similar like this to render thumbnail of websites (at a very small file-size). E.g. https://twitter.com/yvoschaap/status/1446397003316047872 h

I tried something similar like this to render thumbnail of websites (at a very small file-size). E.g. https://twitter.com/yvoschaap/status/1446397003316047872 https://twitter.com/yvoschaap/status/1446397003316047872

codetrotter 4y ago
That is super neat! Did you end up having any users/customers?
mrkramer 4y ago
Isn't this something like archive.ph is doing? Snapshotting and screenshotting websites. I'm referring both to you and the op.
- dj_gitmo 4y ago
  https://archive.ph/1NNZr https://archive.ph/1NNZr That looks like a Web Archive (WARC) and a PNG screen shot. I think you can make a screenshot with CasperJS. The WARC can be created by wget.
  - mrkramer 4y ago
    Yea you are right about PNG but wrong about WARC. Archive.ph doesn't use WARC.
    - dredmorbius 4y ago
      What does it use, if you know? Source?
      - mrkramer 4y ago
        Their FAQ says: https://archive.ph/faq#:~:text=Which%20parts%20of,of%201024x768%20pixels https://archive.ph/faq#:~:text=Which%20parts%20of,of%201024x.... Wikipedia says: https://en.wikipedia.org/wiki/Archive.today#:~:text=Web%20pages%20cannot%20be%20duplicated%20from%20archive.today%20to%20web.archive.org%20as%20second%2Dlevel%20backup%2C%20as%20archive.today%20places%20an%20exclusion%20for%20Wayback%20Machine%20and%20does%20not%20save%20its%20snapshots%20in%20WARC%20format https://en.wikipedia.org/wiki/Archive.today#:~:text=Web%20pa.... So I assumed they don't use it but idk for sure.
        dredmorbius 4y ago
        Thanks.
marginalia_nu 4y ago
How small are you getting them? I'm straight up screenshotting websites (e.g. https://search.marginalia.nu/screenshot/245804 https://search.marginalia.nu/screenshot/245804). Seem to come in at on average 17 Kb, based on a sample size of 550K screenshots.
- fy20 4y ago
  That's pretty cool! How do you go about removing the details? Is it done in JavaScript before the screenshot is taken, or by post-processing the SVG?

codetrotter 4y ago

That is super neat! Did you end up having any users/customers?

mrkramer 4y ago

Isn't this something like archive.ph is doing? Snapshotting and screenshotting websites. I'm referring both to you and the op.

dj_gitmo 4y ago
https://archive.ph/1NNZr https://archive.ph/1NNZr That looks like a Web Archive (WARC) and a PNG screen shot. I think you can make a screenshot with CasperJS. The WARC can be created by wget.
- mrkramer 4y ago
  Yea you are right about PNG but wrong about WARC. Archive.ph doesn't use WARC.
  - dredmorbius 4y ago
    What does it use, if you know? Source?
    - mrkramer 4y ago
      Their FAQ says: https://archive.ph/faq#:~:text=Which%20parts%20of,of%201024x768%20pixels https://archive.ph/faq#:~:text=Which%20parts%20of,of%201024x.... Wikipedia says: https://en.wikipedia.org/wiki/Archive.today#:~:text=Web%20pages%20cannot%20be%20duplicated%20from%20archive.today%20to%20web.archive.org%20as%20second%2Dlevel%20backup%2C%20as%20archive.today%20places%20an%20exclusion%20for%20Wayback%20Machine%20and%20does%20not%20save%20its%20snapshots%20in%20WARC%20format https://en.wikipedia.org/wiki/Archive.today#:~:text=Web%20pa.... So I assumed they don't use it but idk for sure.
      - dredmorbius 4y ago
        Thanks.

marginalia_nu 4y ago

How small are you getting them? I'm straight up screenshotting websites (e.g. https://search.marginalia.nu/screenshot/245804 https://search.marginalia.nu/screenshot/245804). Seem to come in at on average 17 Kb, based on a sample size of 550K screenshots.

fy20 4y ago
That's pretty cool! How do you go about removing the details? Is it done in JavaScript before the screenshot is taken, or by post-processing the SVG?