3 ms·

I'm not sur at which level you ask this. For storing the images, Base64 encoded in the HTML files. For making them useful, I don't think it's the most important

I'm not sur at which level you ask this. For storing the images, Base64 encoded in the HTML files. For making them useful, I don't think it's the most important feature, but if need be it is possible to think about using OCR for extracting text, or Deep Learning for describing them [1]. [1] https://research.googleblog.com/2014/11/a-picture-is-worth-thousand-coherent.html https://research.googleblog.com/2014/11/a-picture-is-worth-t...

asaddhamani 9y ago
The average web page is around 2MB, 60% of which is images [1]. Base64 encoding makes the size even larger. Would that compromise on higher disk usage make sense for you? I like both the OCR and DL ideas. Shameless plug, I've been working on a bookmarking service (https://github.com/crestify/crestify https://github.com/crestify/crestify), and local archiving with images is something we're looking at add. Since it is something a lot of people seem to want, contributors are welcome :). [1] https://www.soasta.com/blog/page-bloat-average-web-page-2-mb/ https://www.soasta.com/blog/page-bloat-average-web-page-2-mb...
- StreakyCobra 9y ago
  The system I propose would be for sure space-consuming. Removing the ads and other unneeded contents would probably help to shrink down the page size though. This is the price to pay to keep the bookmarked content available in the long-term, and I'm ready to pay this "price". Assuming 1 bookmark per day during 10 years, this will sum up around 8 Go. Storage is cheep enough nowadays so I can support these 8 Go over 10 years. This will probably not be mobile-friendly, but I'm almost never consulting bookmarks from my phone anyway. Your project seems interesting, thanks for sharing! This may be especially useful to see how you implemented the readability part.
  - asaddhamani 9y ago
    According to this post[1], Pinboard had 26M new bookmarks in 1 year (15-16), between 24.5K users, which is close to ~1100 bookmarks per user per year, 3 per day. ~22GB for 10 years. Compression and other optimizations could reduce that further. Crestify is a web application, so you could run it on a server and access it over a mobile app. Really happy to hear you like it. And I'm always open to new ideas about it :). [1] https://blog.pinboard.in/2016/07/pinboard_turns_seven/ https://blog.pinboard.in/2016/07/pinboard_turns_seven/
benibela 9y ago
I meant bookmarks to pictures. Like infographics or memes
- StreakyCobra 9y ago
  Oh, I'm not bookmarking such kind of content usually. I guess in any case a system that check the type of content (html/image/sound/video) will be needed to select the storage format, so the annotation may then also be adapted to the content type. In any case a way to manually add tag would exist so it's feasible to add such content.

asaddhamani 9y ago

The average web page is around 2MB, 60% of which is images [1]. Base64 encoding makes the size even larger. Would that compromise on higher disk usage make sense for you? I like both the OCR and DL ideas. Shameless plug, I've been working on a bookmarking service (https://github.com/crestify/crestify https://github.com/crestify/crestify), and local archiving with images is something we're looking at add. Since it is something a lot of people seem to want, contributors are welcome :). [1] https://www.soasta.com/blog/page-bloat-average-web-page-2-mb/ https://www.soasta.com/blog/page-bloat-average-web-page-2-mb...

StreakyCobra 9y ago
The system I propose would be for sure space-consuming. Removing the ads and other unneeded contents would probably help to shrink down the page size though. This is the price to pay to keep the bookmarked content available in the long-term, and I'm ready to pay this "price". Assuming 1 bookmark per day during 10 years, this will sum up around 8 Go. Storage is cheep enough nowadays so I can support these 8 Go over 10 years. This will probably not be mobile-friendly, but I'm almost never consulting bookmarks from my phone anyway. Your project seems interesting, thanks for sharing! This may be especially useful to see how you implemented the readability part.
- asaddhamani 9y ago
  According to this post[1], Pinboard had 26M new bookmarks in 1 year (15-16), between 24.5K users, which is close to ~1100 bookmarks per user per year, 3 per day. ~22GB for 10 years. Compression and other optimizations could reduce that further. Crestify is a web application, so you could run it on a server and access it over a mobile app. Really happy to hear you like it. And I'm always open to new ideas about it :). [1] https://blog.pinboard.in/2016/07/pinboard_turns_seven/ https://blog.pinboard.in/2016/07/pinboard_turns_seven/

benibela 9y ago

I meant bookmarks to pictures. Like infographics or memes

StreakyCobra 9y ago
Oh, I'm not bookmarking such kind of content usually. I guess in any case a system that check the type of content (html/image/sound/video) will be needed to select the storage format, so the annotation may then also be adapted to the content type. In any case a way to manually add tag would exist so it's feasible to add such content.