11 ms·

How to annotate everything

315 points by pcr910303 7y ago

shostack 7y ago
Are there tools good for aggregating and querying annotations across services for less technical users? Is there a market for better usage of annotations? I've been avid about annotating key tools I use that offer that functionality, and inevitably creating a separate spreadsheet log across things. I'd love something that could be a hub for all my annotations.
- karlicoss 7y ago
  I'm actually working on a tool that aggregates annotations across different services https://github.com/karlicoss/promnesia https://github.com/karlicoss/promnesia (screenshot is a bit old, e.g. currently it's capable of displaying inline highlights as well). I've been using it for almost a year now, but it needs few final touches before I can release it. The 'less technical users' bit is tricky one. I am trying to make it as effortless as possible, but there is some inevitable overhead for running export scripts, configuring etc. I'm also working on a post exploring this overhead and thinking of ways to make it better :)
shameempk 7y ago
I would suggest "Article Reader" on Android. I have been using it for a while now.
karanbhangui 7y ago
the main issue I have with native PDF annotation is that it mutates the file, which changes the hash. I've been thinking about building a collaborative PDF reader (using native PDF toolkits, not pdf.js) that fingerprints the file locally and pulls/pushes annotations to a central repository (either self hosted by individuals, research teams) or globally. Would love to see annotations on popular research papers or textbooks.
- jks 7y ago
  At least in principle it is possible to annotate a PDF file while leaving the original file as a prefix of the end result. The directory of objects is at the end of the file, so the annotation software can build a new tree of objects, referencing any unchanged parts of the original, and append its own directory which the reader software will find. I don't know of any PDF editors that do this, though.
- AlanYx 7y ago
  What you're suggesting would be amazing. For what it's worth, the popular "Skim" PDF reader on OS X stores annotations in filesystem extended attributes, so the hash of the raw file data doesn't change (but of course this comes with the drawback of more limited interoperability with other tools).
- jjohansson 7y ago
  this really depends on the annotation app. ISO-conformant PDF viewers support XFDF annotations, which can either be burned into the PDF, or stored separately. the behaviour is entirely viewer-specific.
- shalabhc 7y ago
  hypothes.is does exactly this, except it uses pdf.js It doesn't matter where you load a PDF from (locally or any online source) the public annotations are overlaid.
- bhl 7y ago
  There's Fermat's Library [1] which allows for collaborative annotation on pdfs. The only issue I have with them is that they lack highlighting and aren't open source. With PDF annotation, why not separate the content from the content representation? Have an editor for the original content, and export to pdf. If people want to annotate, give the original content or a copy. Easier to version control this way as well. [1] https://fermatslibrary.com/ https://fermatslibrary.com/
- karlicoss 7y ago
  Hey, author here! Polar Bookshelf does exactly what you want, I recommend trying it out. It's mentioned in the article here https://beepb00p.xyz/annotating.html#polar https://beepb00p.xyz/annotating.html#polar
daok 7y ago
Microsoft OneNote should be somewhere on that list. You can annotate PDF, Powerpoint or images easily. There is an extension that lets you annotate a complete webpage or a portion as well. You can annotate with your keyboard and your pen. You can also share to have collaboration with many people as well as use it across devices (Android, Mac, Windows).
- ortusdux 7y ago
  I 2nd OneNote. I used it extensively in college. You can migrate in chapters of a pdf textbook, OCR the text, and then highlight and annotate to your hearts content. It supports hyperlinking, which I used to make an interlinked glossary that spanned textbooks. You can 'print' any document/webpage to onenote as well as take screencaps. I still use win+shift+s to clip portions of the screen.
- rollinDyno 7y ago
  OneNote would be ideal but I wish I could keep the PDF file in my local directory rather than in the cloud. This is because I use Zotero where I link my PDF files stored in a local directory. Edit: just played with OneNote once again. I realised it's also lacking bookmarking and thumbnail views.
- raxxorrax 7y ago
  Can you save your notebook in a portable format for import/export now? I think that is a basic feature of a notebook and always felt that it was intentionally missing to suck people into the MS cloud. Not saying a lot of other apps don't make the same mistake.
  - mxuribe 7y ago
    Yep, this 100%.
- karlicoss 7y ago
  Hey, author here. I don't have any windows computers, so haven't had chance to use Microsoft products much. I'll mention onenote anyway to prompt people, thanks!
noname120 7y ago
Related: https://news.ycombinator.com/item?id=21642289 https://news.ycombinator.com/item?id=21642289
hiccuphippo 7y ago
How to annotate code? I've once in a while wanted some tool to annotate code as I explain it to new developers, or as I explore code I'm unfamiliar with, without having to write comments directly in the source code. The closest I've found to do this is bookmarks in IntelliJ using the name of the bookmark as the annotation.
- Splognosticus 7y ago
  Why not just actually use comments? If it's worth explaining to new developers it'll likely be useful later when you've simply forgotten why something is the way it is.
  - cfors 7y ago
    Seriously. Especially when something seems like a bizarre choice in the code, I'll provide a link if there is a corresponding GitHub issue or code regarding it. I've never had an issue with GitHub issues regarding linkrot, but it happens quite frequently when linking actual source code, especially code not in your control. Not sure what a better solution is for that, unfortunately. I generally justify it by the anecdotal observation that the code is generally not being used anymore by the time the link dies out, but that is far from an ideal justification.
    - jakub_g 7y ago
      Assuming you use GitHub for source control: - Go to GitHub.com repo and find the file (You can use 't' keyboard shortcut to find it) - Press 'y' on keyboard to replace 'master' with its SHA1 in the URL - Click on the interesting line of code - You have a forever-valid link (assuming no push --force) to the exact line of code
      - gugagore 7y ago
        I thought a push --force would change the hash, anyway.
deleted 7y ago
[deleted]
gildas 7y ago
I think you could add the browser add-on SingleFile [1] to the list which allows you to annotate archive of webpages saved in HTML and is 100% free. [1] https://github.com/gildas-lormeau/SingleFile https://github.com/gildas-lormeau/SingleFile
djhworld 7y ago
One thing I hate about annotation in general is everything is siloed. For example, I have an app on my iPad called PDF Viewer (I think) which is pretty good and has lots of annotating features. I've often used it to highlight pieces of text I'm interested in, or references I might want to follow up on The follow ups never happen though because the annotations are locked in this app, I can't say, look on my mac to see what I've 'clipped' recently from the app on my ipad, or most other apps for that matter. Ideally what I'd like is some sort of central place where all my 'clippings' go in a seamless manner, be it from PDFs, photos, websites, whatever.
- j88439h84 7y ago
  This is a really good idea. It means there needs to be standard way to specify the relevant location for a note inside each media format.
  - scottshamus 7y ago
    There has been active work on this: https://www.w3.org/annotation/ https://www.w3.org/annotation/ It says web annotation but it was born out of an open annotation initiative. The fragment selector supports the most common media types https://www.w3.org/TR/annotation-model/#fragment-selector https://www.w3.org/TR/annotation-model/#fragment-selector
- maire 7y ago
  I was a little confused about the PDF annotation part of the discussion since this works for me. The author does say that he doesn't have a mac and this might be the issue. It works across all of my devices and all of my apps. Annotation itself is part of the PDF standard. It is defined well enough that all of the apps I use preserve annotation. The parts that are missing are both provided by Evernote. Evernote inserts the major annotations at the start of the file. You can then read a summary of annotations in any PDF app. Evernote was also the first that automatically converted image based pdfs to "searchable pdfs". When this feature first came out it was awesome. Now I see it everywhere. My scanner automatically converts to searchable pdfs and I have an OCR converter that does the same.
kirubakaran 7y ago
One of the first features I built for https://histre.com/ https://histre.com/ is annotating websites. I find tagging, grouping and sharing those notes to be incredibly useful. My girlfriend was trying to shortlist Airbnbs and places to visit for a recent trip and it was satisfying to see how Histre make that really easy.
rollinDyno 7y ago
Okular was my favorite PDF annotator until I got my Surface Pro a couple of days ago. I still haven't figured out what's the best PDF reader with pen input, any recommendations?
kubanczyk 7y ago
What about annotating e-mails? Any tools that can aggregate such annotations with other types (e.g. web)?
- sachdevap 7y ago
  I suggest looking into org-mode in emacs to take notes on emails. However, I have not yet figured out an annotation method that works. Would be good to have one, but given that the emails are not long, may be a little unnecessary.
kd5bjo 7y ago
Does anyone know of a good guide or reference of what to write in annotations or notes? Every notetaking guide I’ve seen seems to talk exclusively about mechanics and not content, which seems like the harder part to me.
- nefitty 7y ago
  How about trying to "explain like I'm five", or writing an explanation of what you just t read from memory until you hit a wall. The wall signifies something you should go back and try to understand better.
  - kd5bjo 7y ago
    I was hoping for something more along the lines of a book, blog, or academic paper that goes into the subject in some detail.
j45 7y ago
Helpful list, thanks for sharing.
gobengo 7y ago
If you're interested in annotation, you may also enjoy these standards/communities, which aren't referenced in the article: - Open Annotation Data Model[1] - Web Annotation Vocabulary[2]: I built a thing to convert kindle highlights/notes into web annotation vocabulary jsonld[3] - Web Annotation Protocol[4] Great to see https://hypothes.is https://hypothes.is mentioned. Great people on that team, and a great example of a dedicated tech nonprofit. Just this week I have been fulfilling our first customer order to provide hosting for hypothesis annotation server on permanent.cloud[5]. One area of needed development, however, is being able to use the browser extension[6], which is great, with your own installation and not just the main https:/hypothes.is domain. I'll probably contribute that sooner or later, or else continue work on this other simpler browser extension I started[7] Lastly, there are some interesting tricky CS/NLP problems of 'annotating everything', e.g. how to render annotations on the right 'target' of what was annotated, especially if that target has changed a little bit, e.g. fixing a typo or something, which is common in web publishing / news. In 2014 I worked for a company that made an annotation-as-a-service product, and I wrote a bit about how Locality-sensitive Hashing can be applied[8] [1]: http://www.openannotation.org/spec/core/ http://www.openannotation.org/spec/core/ [2]: https://www.w3.org/TR/annotation-vocab/ https://www.w3.org/TR/annotation-vocab/ [3]: https://github.com/gobengo/kindle-web-annotations https://github.com/gobengo/kindle-web-annotations [4]: https://www.w3.org/TR/annotation-protocol/ https://www.w3.org/TR/annotation-protocol/ [5]: https://permanent.cloud/apps/hypothesis https://permanent.cloud/apps/hypothesis [5]: https://github.com/hypothesis/browser-extension https://github.com/hypothesis/browser-extension [6]: https://github.com/gobengo/kindle-web-annotations https://github.com/gobengo/kindle-web-annotations [7]: https://github.com/gobengo/web-annotation-extension https://github.com/gobengo/web-annotation-extension [8]: https://gobengo.tumblr.com/day/2014/04/22 https://gobengo.tumblr.com/day/2014/04/22
- detaro 7y ago
  Are there any active projects building around Web Annotation? It seemed interesting, but when it was released it also seemed like a lot of talk with not even experimental implementations (to the point where it seemed not enough to actually be released as a standard). Hypothesis was loudly praising it, all the while keeping their product on their own protocols.
TeMPOraL 7y ago
Windows applications are conspicuously missing from the list. Others mentioned OneNote. For PDF annotations, Edge browser isn't all that bad. Foxit had some features too, AFAIR (and is cross-platform). Personally, I currently use Drawboard PDF - it's UWP, but a very nice and stylus-friendly viewer with a lot of annotation capabilities and a circular menu that's extra convenient when using a stylus.
- karlicoss 7y ago
  Hey, author here! Reason is I don't have any windows computers, so have no idea what's going on in windows world! (should have mentioned that) Thanks for tools listed in your comment, I'll mention these in the article.
mhasbini 7y ago
I've created Quoter[0] to address this point in particular. I read a fair amount of materials on daily basis (books, blogs, discussions) and some times I want a to save a sentence. With Quoter it's just one click away. To get reminded about the quotes (or annotations) that I've saved: I've configure it to show a random quote every 3 hours. This quote was shown when I was writing this comment :) >Every time you create something – whether it's a website, a client app, a blog post, a powerpoint presentation, or an email – ask yourself, "so what?" If you can't answer that question convincingly, reformulate and try again. It also have the ability to export saved quotes, I a script to process the output to a page on my website[1]. [0] https://getquoter.app/ https://getquoter.app/ [1] https://mhasbini.com/highlights.html https://mhasbini.com/highlights.html
- hiccuphippo 7y ago
  Cool. It would be nice if it could also show a link to the source of the quote in the export.
  - mhasbini 7y ago
    Thanks, I'm working on adding this.
melvinroest 7y ago
I'd like you to consider doodledocs.com, which is my side project. I recently submitted it as a show HN [1]. It has a web annotation feature in which you can draw over a website with your stylus. I haven't seen the combination of a pressure sensitive stylus web annotation collaborative doodle app. It's still very much an MVP though, so the collaborative aspect doesn't always work. The annotation aspect should work a lot better. I wish I could pursue this project as a small company (I have quite a lot of ideas in this area), but I'm having a hard time finding the audience who might enjoy this (currently that says more about my marketing skills than anything else). So side project it is. Edit: Bluebeam, Good Notes and Apple Books are missing [2]. It seems that there is no consideration for stylus-based annotation. [1] https://news.ycombinator.com/item?id=21399910 https://news.ycombinator.com/item?id=21399910 [2] As an aside, I recommend Good Notes over Apple Books, but it's close. Bluebeam is a good application if you have a Microsoft Surface.
gsoltis 7y ago
My company, Gold Fig(https://goldfiglabs.com https://goldfiglabs.com), is working on something just adjacent to annotating webpages: we enable you to annotate changes you make on the web. Since so much of our work is powered by online platforms, we wanted a way to keep track of changes we were making in the tools we were using. Similar to how you would annotate a code change with a commit message, you should be able to annotate a CMS change, a platform settings change, or anything else you might be tweaking as you go about your work. We'd love feedback from anyone who is interested in adding annotations, and especially those working on teams who could benefit from being able to share annotations. We definitely understand that a lot of data is currently siloed, so to that end we're also interested in the annotation formats that we should be looking at. We currently export our own json format, but we would love to work well with existing tools.
- criddell 7y ago
  Will your system work with Netflix in the browser?
  - gsoltis 7y ago
    Hmm, maybe. Can you provide more details about what specifically you are trying to accomplish?
    - criddell 7y ago
      Annotate movies. The introduction of the protagonist, the end of act I, document great lighting or an exceptional score.
deleted 7y ago
[deleted]
ydb 7y ago
Could have used this list while doing research for my Masters! However, I don't think I was as well-versed in emacs back then either, ha ha.
Erwin 7y ago
I've been pleased with Memex WorldBrain, which was recently demonstrated here on HN: you can annotate or star your pages, and every page starred/bookmarked, or visited for some seconds is searchable. If you do a web search on DDG, your Memex results also pop up at the same time.
artur_makly 7y ago
Coincidentally we're about to embark on adding annotations & workflow management to our automated visual sitemaps platform: https://visualsitemaps.com/annotations/ https://visualsitemaps.com/annotations/
philyg 7y ago
For videos, I have found this: https://ant.umn.edu/ https://ant.umn.edu/ , but haven't used it yet. It seems a bit limited in its annotation abilities, but nevertheless something that could be useful
hyperion2010 7y ago
One thing that seems to be missing from the list is org-capture, which is lightly documented bit can duplicate quite a bit of the hypothes.is functionality, though the tweaking required is quite high.
rrdharan 7y ago
Seems kind of funny and sad given how much fanfare and money was associated with them, that in both TFA and this entire discussion, no one has mentioned genius.com (http://nymag.com/daily/intelligencer/2014/12/genius-minus-the-rap.html http://nymag.com/daily/intelligencer/2014/12/genius-minus-th...).
- jgalt212 7y ago
  any word on what a16z has this investment marked at?
dredmorbius 7y ago
I really appreciate this resource, though it largely underlines the fact that there really aren't any good comprehensive solutions. Zotero appears conspicuously missing. It's an articles / references management tool. I've not found it especially useful myself, though it has its fans. My own previous explorations, somewhat disorganised: "Sources and tools for references, particularly document scanning and conversion" https://old.reddit.com/r/dredmorbius/comments/6tr7za/sources_and_tools_for_references_particularly/ https://old.reddit.com/r/dredmorbius/comments/6tr7za/sources... "Organising and planning research activities" https://ello.co/dredmorbius/post/fj5rzi8zmouyrmvg8yzzva https://ello.co/dredmorbius/post/fj5rzi8zmouyrmvg8yzzva Regarding digital formats generally: - Most formats are themelves opaque / resistant to annotations, in some way, shape, or form. - Tools that enable annotations of one type of reference ... often don't support others. As several comments note, this results in various application or service-based silos of notes. - Index cards remain remarkably useful. I use a modified POIC / Zettelkasten method: https://ello.co/dredmorbius/post/u4dgr0tkxk4tk9npuvex5a https://ello.co/dredmorbius/post/u4dgr0tkxk4tk9npuvex5a Mostly, I've been looking to a generalised system for organising and working with materials under the working titles of KFC (Krell Functional/Fine Context), docFS (as in "Document Filesystem"), and webFS (as in Web filesystem, see: "What if the Web was fileystem accessible" https://old.reddit.com/r/dredmorbius/comments/6bgowu/what_if_the_web_was_filesystemaccessible/ https://old.reddit.com/r/dredmorbius/comments/6bgowu/what_if...). The idea of creating not an application, but an OS-level (and ultimately, hopefully, OS-agnostic) system for integrating metadata and relationships amongst documents, is at its heart. This does seem like a surprisingly common problem, and one with numerous partial solutions, but no generally-available, general-purpose system seems to exist. Given that this notion dates back to (or before!) Vannevar Bush's Memex discussion, this is ... both surprising and disappointing. I'm about 98.2331% certain that copyright has a major share of the blame, as an effective system for dealing with digitised documents would all but certainly have to involve duplicating and reverse-engineering them in multiple regards. My solution to the HTML / PDF / ePub, etc., document formats is to recompose them as some minimally sufficient document format (often Markdown, occasionally more advanced formats, with LaTeX being nearly always sufficient). This has resulted in a significant detour through questions concerning typography and just what a document is, though in a huge fraction of cases, there's little reason to go beyond paragraphs, the occasional italic/bold emphasis, and section or chapter markings. In trying to decompose Web content, it's almost always simplest to simply dump the document to plain ASCII, then re-introduce any needed markup. Parsing HTML itself to a normalised form is a fool's errand. (As a fool, I've been on that errand many times.) It's possible to start from raw ASCII text for a book-length work and re-introduce Markdown sufficient to create HTML, PDF, and ePub endpoints in an hour or so, for a fictional work with no significant typographic concerns. I've even resorted to hand-typing works on occasion. Excessive of itself, but with the added bonus of being an effective active-reading technique. That said: none of my methods, nor those listed here, satisfy me. Though Wallabag deserves a closer look.

315 points by pcr910303 7y ago

Are there tools good for aggregating and querying annotations across services for less technical users? Is there a market for better usage of annotations? I've been avid about annotating key tools I use that offer that functionality, and inevitably creating a separate spreadsheet log across things. I'd love something that could be a hub for all my annotations.

karlicoss 7y ago
I'm actually working on a tool that aggregates annotations across different services https://github.com/karlicoss/promnesia https://github.com/karlicoss/promnesia (screenshot is a bit old, e.g. currently it's capable of displaying inline highlights as well). I've been using it for almost a year now, but it needs few final touches before I can release it. The 'less technical users' bit is tricky one. I am trying to make it as effortless as possible, but there is some inevitable overhead for running export scripts, configuring etc. I'm also working on a post exploring this overhead and thinking of ways to make it better :)

shameempk 7y ago

I would suggest "Article Reader" on Android. I have been using it for a while now.

karanbhangui 7y ago

the main issue I have with native PDF annotation is that it mutates the file, which changes the hash. I've been thinking about building a collaborative PDF reader (using native PDF toolkits, not pdf.js) that fingerprints the file locally and pulls/pushes annotations to a central repository (either self hosted by individuals, research teams) or globally. Would love to see annotations on popular research papers or textbooks.

jks 7y ago
At least in principle it is possible to annotate a PDF file while leaving the original file as a prefix of the end result. The directory of objects is at the end of the file, so the annotation software can build a new tree of objects, referencing any unchanged parts of the original, and append its own directory which the reader software will find. I don't know of any PDF editors that do this, though.
AlanYx 7y ago
What you're suggesting would be amazing. For what it's worth, the popular "Skim" PDF reader on OS X stores annotations in filesystem extended attributes, so the hash of the raw file data doesn't change (but of course this comes with the drawback of more limited interoperability with other tools).
jjohansson 7y ago
this really depends on the annotation app. ISO-conformant PDF viewers support XFDF annotations, which can either be burned into the PDF, or stored separately. the behaviour is entirely viewer-specific.
shalabhc 7y ago
hypothes.is does exactly this, except it uses pdf.js It doesn't matter where you load a PDF from (locally or any online source) the public annotations are overlaid.
bhl 7y ago
There's Fermat's Library [1] which allows for collaborative annotation on pdfs. The only issue I have with them is that they lack highlighting and aren't open source. With PDF annotation, why not separate the content from the content representation? Have an editor for the original content, and export to pdf. If people want to annotate, give the original content or a copy. Easier to version control this way as well. [1] https://fermatslibrary.com/ https://fermatslibrary.com/
karlicoss 7y ago
Hey, author here! Polar Bookshelf does exactly what you want, I recommend trying it out. It's mentioned in the article here https://beepb00p.xyz/annotating.html#polar https://beepb00p.xyz/annotating.html#polar

daok 7y ago

Microsoft OneNote should be somewhere on that list. You can annotate PDF, Powerpoint or images easily. There is an extension that lets you annotate a complete webpage or a portion as well. You can annotate with your keyboard and your pen. You can also share to have collaboration with many people as well as use it across devices (Android, Mac, Windows).

ortusdux 7y ago
I 2nd OneNote. I used it extensively in college. You can migrate in chapters of a pdf textbook, OCR the text, and then highlight and annotate to your hearts content. It supports hyperlinking, which I used to make an interlinked glossary that spanned textbooks. You can 'print' any document/webpage to onenote as well as take screencaps. I still use win+shift+s to clip portions of the screen.
rollinDyno 7y ago
OneNote would be ideal but I wish I could keep the PDF file in my local directory rather than in the cloud. This is because I use Zotero where I link my PDF files stored in a local directory. Edit: just played with OneNote once again. I realised it's also lacking bookmarking and thumbnail views.
raxxorrax 7y ago
Can you save your notebook in a portable format for import/export now? I think that is a basic feature of a notebook and always felt that it was intentionally missing to suck people into the MS cloud. Not saying a lot of other apps don't make the same mistake.
- mxuribe 7y ago
  Yep, this 100%.
karlicoss 7y ago
Hey, author here. I don't have any windows computers, so haven't had chance to use Microsoft products much. I'll mention onenote anyway to prompt people, thanks!

noname120 7y ago

Related: https://news.ycombinator.com/item?id=21642289 https://news.ycombinator.com/item?id=21642289

hiccuphippo 7y ago

How to annotate code? I've once in a while wanted some tool to annotate code as I explain it to new developers, or as I explore code I'm unfamiliar with, without having to write comments directly in the source code. The closest I've found to do this is bookmarks in IntelliJ using the name of the bookmark as the annotation.

Splognosticus 7y ago
Why not just actually use comments? If it's worth explaining to new developers it'll likely be useful later when you've simply forgotten why something is the way it is.
- cfors 7y ago
  Seriously. Especially when something seems like a bizarre choice in the code, I'll provide a link if there is a corresponding GitHub issue or code regarding it. I've never had an issue with GitHub issues regarding linkrot, but it happens quite frequently when linking actual source code, especially code not in your control. Not sure what a better solution is for that, unfortunately. I generally justify it by the anecdotal observation that the code is generally not being used anymore by the time the link dies out, but that is far from an ideal justification.
  - jakub_g 7y ago
    Assuming you use GitHub for source control: - Go to GitHub.com repo and find the file (You can use 't' keyboard shortcut to find it) - Press 'y' on keyboard to replace 'master' with its SHA1 in the URL - Click on the interesting line of code - You have a forever-valid link (assuming no push --force) to the exact line of code
    - gugagore 7y ago
      I thought a push --force would change the hash, anyway.

deleted 7y ago

[deleted]

gildas 7y ago

I think you could add the browser add-on SingleFile [1] to the list which allows you to annotate archive of webpages saved in HTML and is 100% free. [1] https://github.com/gildas-lormeau/SingleFile https://github.com/gildas-lormeau/SingleFile

djhworld 7y ago

One thing I hate about annotation in general is everything is siloed. For example, I have an app on my iPad called PDF Viewer (I think) which is pretty good and has lots of annotating features. I've often used it to highlight pieces of text I'm interested in, or references I might want to follow up on The follow ups never happen though because the annotations are locked in this app, I can't say, look on my mac to see what I've 'clipped' recently from the app on my ipad, or most other apps for that matter. Ideally what I'd like is some sort of central place where all my 'clippings' go in a seamless manner, be it from PDFs, photos, websites, whatever.

j88439h84 7y ago
This is a really good idea. It means there needs to be standard way to specify the relevant location for a note inside each media format.
- scottshamus 7y ago
  There has been active work on this: https://www.w3.org/annotation/ https://www.w3.org/annotation/ It says web annotation but it was born out of an open annotation initiative. The fragment selector supports the most common media types https://www.w3.org/TR/annotation-model/#fragment-selector https://www.w3.org/TR/annotation-model/#fragment-selector
maire 7y ago
I was a little confused about the PDF annotation part of the discussion since this works for me. The author does say that he doesn't have a mac and this might be the issue. It works across all of my devices and all of my apps. Annotation itself is part of the PDF standard. It is defined well enough that all of the apps I use preserve annotation. The parts that are missing are both provided by Evernote. Evernote inserts the major annotations at the start of the file. You can then read a summary of annotations in any PDF app. Evernote was also the first that automatically converted image based pdfs to "searchable pdfs". When this feature first came out it was awesome. Now I see it everywhere. My scanner automatically converts to searchable pdfs and I have an OCR converter that does the same.

kirubakaran 7y ago

One of the first features I built for https://histre.com/ https://histre.com/ is annotating websites. I find tagging, grouping and sharing those notes to be incredibly useful. My girlfriend was trying to shortlist Airbnbs and places to visit for a recent trip and it was satisfying to see how Histre make that really easy.

rollinDyno 7y ago

Okular was my favorite PDF annotator until I got my Surface Pro a couple of days ago. I still haven't figured out what's the best PDF reader with pen input, any recommendations?

kubanczyk 7y ago

What about annotating e-mails? Any tools that can aggregate such annotations with other types (e.g. web)?

sachdevap 7y ago
I suggest looking into org-mode in emacs to take notes on emails. However, I have not yet figured out an annotation method that works. Would be good to have one, but given that the emails are not long, may be a little unnecessary.

kd5bjo 7y ago

Does anyone know of a good guide or reference of what to write in annotations or notes? Every notetaking guide I’ve seen seems to talk exclusively about mechanics and not content, which seems like the harder part to me.

nefitty 7y ago
How about trying to "explain like I'm five", or writing an explanation of what you just t read from memory until you hit a wall. The wall signifies something you should go back and try to understand better.
- kd5bjo 7y ago
  I was hoping for something more along the lines of a book, blog, or academic paper that goes into the subject in some detail.

j45 7y ago

Helpful list, thanks for sharing.

gobengo 7y ago

If you're interested in annotation, you may also enjoy these standards/communities, which aren't referenced in the article: - Open Annotation Data Model[1] - Web Annotation Vocabulary[2]: I built a thing to convert kindle highlights/notes into web annotation vocabulary jsonld[3] - Web Annotation Protocol[4] Great to see https://hypothes.is https://hypothes.is mentioned. Great people on that team, and a great example of a dedicated tech nonprofit. Just this week I have been fulfilling our first customer order to provide hosting for hypothesis annotation server on permanent.cloud[5]. One area of needed development, however, is being able to use the browser extension[6], which is great, with your own installation and not just the main https:/hypothes.is domain. I'll probably contribute that sooner or later, or else continue work on this other simpler browser extension I started[7] Lastly, there are some interesting tricky CS/NLP problems of 'annotating everything', e.g. how to render annotations on the right 'target' of what was annotated, especially if that target has changed a little bit, e.g. fixing a typo or something, which is common in web publishing / news. In 2014 I worked for a company that made an annotation-as-a-service product, and I wrote a bit about how Locality-sensitive Hashing can be applied[8] [1]: http://www.openannotation.org/spec/core/ http://www.openannotation.org/spec/core/ [2]: https://www.w3.org/TR/annotation-vocab/ https://www.w3.org/TR/annotation-vocab/ [3]: https://github.com/gobengo/kindle-web-annotations https://github.com/gobengo/kindle-web-annotations [4]: https://www.w3.org/TR/annotation-protocol/ https://www.w3.org/TR/annotation-protocol/ [5]: https://permanent.cloud/apps/hypothesis https://permanent.cloud/apps/hypothesis [5]: https://github.com/hypothesis/browser-extension https://github.com/hypothesis/browser-extension [6]: https://github.com/gobengo/kindle-web-annotations https://github.com/gobengo/kindle-web-annotations [7]: https://github.com/gobengo/web-annotation-extension https://github.com/gobengo/web-annotation-extension [8]: https://gobengo.tumblr.com/day/2014/04/22 https://gobengo.tumblr.com/day/2014/04/22

detaro 7y ago
Are there any active projects building around Web Annotation? It seemed interesting, but when it was released it also seemed like a lot of talk with not even experimental implementations (to the point where it seemed not enough to actually be released as a standard). Hypothesis was loudly praising it, all the while keeping their product on their own protocols.

TeMPOraL 7y ago

Windows applications are conspicuously missing from the list. Others mentioned OneNote. For PDF annotations, Edge browser isn't all that bad. Foxit had some features too, AFAIR (and is cross-platform). Personally, I currently use Drawboard PDF - it's UWP, but a very nice and stylus-friendly viewer with a lot of annotation capabilities and a circular menu that's extra convenient when using a stylus.

karlicoss 7y ago
Hey, author here! Reason is I don't have any windows computers, so have no idea what's going on in windows world! (should have mentioned that) Thanks for tools listed in your comment, I'll mention these in the article.

mhasbini 7y ago

I've created Quoter[0] to address this point in particular. I read a fair amount of materials on daily basis (books, blogs, discussions) and some times I want a to save a sentence. With Quoter it's just one click away. To get reminded about the quotes (or annotations) that I've saved: I've configure it to show a random quote every 3 hours. This quote was shown when I was writing this comment :) >Every time you create something – whether it's a website, a client app, a blog post, a powerpoint presentation, or an email – ask yourself, "so what?" If you can't answer that question convincingly, reformulate and try again. It also have the ability to export saved quotes, I a script to process the output to a page on my website[1]. [0] https://getquoter.app/ https://getquoter.app/ [1] https://mhasbini.com/highlights.html https://mhasbini.com/highlights.html

hiccuphippo 7y ago
Cool. It would be nice if it could also show a link to the source of the quote in the export.
- mhasbini 7y ago
  Thanks, I'm working on adding this.

melvinroest 7y ago

I'd like you to consider doodledocs.com, which is my side project. I recently submitted it as a show HN [1]. It has a web annotation feature in which you can draw over a website with your stylus. I haven't seen the combination of a pressure sensitive stylus web annotation collaborative doodle app. It's still very much an MVP though, so the collaborative aspect doesn't always work. The annotation aspect should work a lot better. I wish I could pursue this project as a small company (I have quite a lot of ideas in this area), but I'm having a hard time finding the audience who might enjoy this (currently that says more about my marketing skills than anything else). So side project it is. Edit: Bluebeam, Good Notes and Apple Books are missing [2]. It seems that there is no consideration for stylus-based annotation. [1] https://news.ycombinator.com/item?id=21399910 https://news.ycombinator.com/item?id=21399910 [2] As an aside, I recommend Good Notes over Apple Books, but it's close. Bluebeam is a good application if you have a Microsoft Surface.

gsoltis 7y ago

My company, Gold Fig(https://goldfiglabs.com https://goldfiglabs.com), is working on something just adjacent to annotating webpages: we enable you to annotate changes you make on the web. Since so much of our work is powered by online platforms, we wanted a way to keep track of changes we were making in the tools we were using. Similar to how you would annotate a code change with a commit message, you should be able to annotate a CMS change, a platform settings change, or anything else you might be tweaking as you go about your work. We'd love feedback from anyone who is interested in adding annotations, and especially those working on teams who could benefit from being able to share annotations. We definitely understand that a lot of data is currently siloed, so to that end we're also interested in the annotation formats that we should be looking at. We currently export our own json format, but we would love to work well with existing tools.

criddell 7y ago
Will your system work with Netflix in the browser?
- gsoltis 7y ago
  Hmm, maybe. Can you provide more details about what specifically you are trying to accomplish?
  - criddell 7y ago
    Annotate movies. The introduction of the protagonist, the end of act I, document great lighting or an exceptional score.

deleted 7y ago

[deleted]

ydb 7y ago

Could have used this list while doing research for my Masters! However, I don't think I was as well-versed in emacs back then either, ha ha.

Erwin 7y ago

I've been pleased with Memex WorldBrain, which was recently demonstrated here on HN: you can annotate or star your pages, and every page starred/bookmarked, or visited for some seconds is searchable. If you do a web search on DDG, your Memex results also pop up at the same time.

artur_makly 7y ago

Coincidentally we're about to embark on adding annotations & workflow management to our automated visual sitemaps platform: https://visualsitemaps.com/annotations/ https://visualsitemaps.com/annotations/

philyg 7y ago

For videos, I have found this: https://ant.umn.edu/ https://ant.umn.edu/ , but haven't used it yet. It seems a bit limited in its annotation abilities, but nevertheless something that could be useful

hyperion2010 7y ago

One thing that seems to be missing from the list is org-capture, which is lightly documented bit can duplicate quite a bit of the hypothes.is functionality, though the tweaking required is quite high.

rrdharan 7y ago

Seems kind of funny and sad given how much fanfare and money was associated with them, that in both TFA and this entire discussion, no one has mentioned genius.com (http://nymag.com/daily/intelligencer/2014/12/genius-minus-the-rap.html http://nymag.com/daily/intelligencer/2014/12/genius-minus-th...).

jgalt212 7y ago
any word on what a16z has this investment marked at?

dredmorbius 7y ago

I really appreciate this resource, though it largely underlines the fact that there really aren't any good comprehensive solutions. Zotero appears conspicuously missing. It's an articles / references management tool. I've not found it especially useful myself, though it has its fans. My own previous explorations, somewhat disorganised: "Sources and tools for references, particularly document scanning and conversion" https://old.reddit.com/r/dredmorbius/comments/6tr7za/sources_and_tools_for_references_particularly/ https://old.reddit.com/r/dredmorbius/comments/6tr7za/sources... "Organising and planning research activities" https://ello.co/dredmorbius/post/fj5rzi8zmouyrmvg8yzzva https://ello.co/dredmorbius/post/fj5rzi8zmouyrmvg8yzzva Regarding digital formats generally: - Most formats are themelves opaque / resistant to annotations, in some way, shape, or form. - Tools that enable annotations of one type of reference ... often don't support others. As several comments note, this results in various application or service-based silos of notes. - Index cards remain remarkably useful. I use a modified POIC / Zettelkasten method: https://ello.co/dredmorbius/post/u4dgr0tkxk4tk9npuvex5a https://ello.co/dredmorbius/post/u4dgr0tkxk4tk9npuvex5a Mostly, I've been looking to a generalised system for organising and working with materials under the working titles of KFC (Krell Functional/Fine Context), docFS (as in "Document Filesystem"), and webFS (as in Web filesystem, see: "What if the Web was fileystem accessible" https://old.reddit.com/r/dredmorbius/comments/6bgowu/what_if_the_web_was_filesystemaccessible/ https://old.reddit.com/r/dredmorbius/comments/6bgowu/what_if...). The idea of creating not an application, but an OS-level (and ultimately, hopefully, OS-agnostic) system for integrating metadata and relationships amongst documents, is at its heart. This does seem like a surprisingly common problem, and one with numerous partial solutions, but no generally-available, general-purpose system seems to exist. Given that this notion dates back to (or before!) Vannevar Bush's Memex discussion, this is ... both surprising and disappointing. I'm about 98.2331% certain that copyright has a major share of the blame, as an effective system for dealing with digitised documents would all but certainly have to involve duplicating and reverse-engineering them in multiple regards. My solution to the HTML / PDF / ePub, etc., document formats is to recompose them as some minimally sufficient document format (often Markdown, occasionally more advanced formats, with LaTeX being nearly always sufficient). This has resulted in a significant detour through questions concerning typography and just what a document is, though in a huge fraction of cases, there's little reason to go beyond paragraphs, the occasional italic/bold emphasis, and section or chapter markings. In trying to decompose Web content, it's almost always simplest to simply dump the document to plain ASCII, then re-introduce any needed markup. Parsing HTML itself to a normalised form is a fool's errand. (As a fool, I've been on that errand many times.) It's possible to start from raw ASCII text for a book-length work and re-introduce Markdown sufficient to create HTML, PDF, and ePub endpoints in an hour or so, for a fictional work with no significant typographic concerns. I've even resorted to hand-typing works on occasion. Excessive of itself, but with the added bonus of being an effective active-reading technique. That said: none of my methods, nor those listed here, satisfy me. Though Wallabag deserves a closer look.