3 ms·
Well, kind of, I don’t think it’s that crazy. This service does two things: * Performs image OCR on images, generically. This is then used for several features
by bri3d 2y ago
Well, kind of, I don’t think it’s that crazy. This service does two things:
* Performs image OCR on images, generically. This is then used for several features: “I type a word in the search box and it can look through my screenshots and photos,” “I’m in one of those horrible scanned image-only PDFs and I want to search,” and so on.
* Performs “main content extraction” on websites by using a screenshot of the website _alongside_ the accessibility tree for that website’s structure. It basically says “given this tree of elements and screenshot, can you prune the tree to just the elements a user would care about.” The fact that this is necessary is more an indictment of the DOM than this feature, IMO :)
- xg15 2y agoAh ok, that seems more sensible. My understanding was it would pretty much literally make screenshots and then run OCR on them. If there is enough smartness to only run OCR on the parts that have no text information, it makes more sense. (Though as we see here, even that approach can be too much)