4 ms·

Do you accept feature requests/think this might be a good idea? I've been thinking about creating this + adding https://github.com/mozilla/readability https://

Do you accept feature requests/think this might be a good idea? I've been thinking about creating this + adding https://github.com/mozilla/readability https://github.com/mozilla/readability to grab the links that are text articles and present them in-page (and cleaned up, just the text+images+similar, removing all the sidebars, popups, etc) instead of having to go to a 3rd party website with all the popups and such. It'd have to be either a personal website or a browser extension like yours, since I wouldn't be able to host a given article for anyone to read (for copyright reasons), but I can have a modified browser that loads a 3rd party article different.

sjdz 4y ago
It's a nice idea! One consideration would be how to grab the html of the pages. In my experience, using either fetch() or an ajax request often runs into problems with CORS etc on the destination site blocking the request. Maybe there's a better way someone knows for extensions to grab remote html without running into these problems? The alternative would be for the extension to grab the html via API from a crawler running on a server (or SaaS), which should work pretty well.
- franciscop 4y ago
  Yes, I'm pretty sure (but not 100%) that extensions normally can avoid CORS/same-origin/etc issues. > The alternative would be for the extension to grab the html via API from a crawler running on a server Oh like 'https://myplainwebsite.com/parse?url=https://example.com/document https://myplainwebsite.com/parse?url=https://example.com/doc...'
- franciscop 4y ago
  So I just launched this inspired on our brief conversation! :) https://content-parser.com/ https://content-parser.com/ You can parse any URL into markdown with `https://content-parser.com/markdown?url={encodeURIComponent(url) https://content-parser.com/markdown?url={encodeURIComponent(...}`.
  - sjdz 4y ago
    That's awesome, works really well! Good luck with it :)

sjdz 4y ago

It's a nice idea! One consideration would be how to grab the html of the pages. In my experience, using either fetch() or an ajax request often runs into problems with CORS etc on the destination site blocking the request. Maybe there's a better way someone knows for extensions to grab remote html without running into these problems? The alternative would be for the extension to grab the html via API from a crawler running on a server (or SaaS), which should work pretty well.

franciscop 4y ago
Yes, I'm pretty sure (but not 100%) that extensions normally can avoid CORS/same-origin/etc issues. > The alternative would be for the extension to grab the html via API from a crawler running on a server Oh like 'https://myplainwebsite.com/parse?url=https://example.com/document https://myplainwebsite.com/parse?url=https://example.com/doc...'
franciscop 4y ago
So I just launched this inspired on our brief conversation! :) https://content-parser.com/ https://content-parser.com/ You can parse any URL into markdown with `https://content-parser.com/markdown?url={encodeURIComponent(url) https://content-parser.com/markdown?url={encodeURIComponent(...}`.
- sjdz 4y ago
  That's awesome, works really well! Good luck with it :)