3 ms·
It's a nice idea! One consideration would be how to grab the html of the pages. In my experience, using either fetch() or an ajax request often runs into proble
by sjdz 4y ago
It's a nice idea! One consideration would be how to grab the html of the pages. In my experience, using either fetch() or an ajax request often runs into problems with CORS etc on the destination site blocking the request.
Maybe there's a better way someone knows for extensions to grab remote html without running into these problems?
The alternative would be for the extension to grab the html via API from a crawler running on a server (or SaaS), which should work pretty well.
- franciscop 4y agoYes, I'm pretty sure (but not 100%) that extensions normally can avoid CORS/same-origin/etc issues. > The alternative would be for the extension to grab the html via API from a crawler running on a server Oh like 'https://myplainwebsite.com/parse?url=https://example.com/document https://myplainwebsite.com/parse?url=https://example.com/doc...'
- franciscop 4y agoSo I just launched this inspired on our brief conversation! :) https://content-parser.com/ https://content-parser.com/ You can parse any URL into markdown with `https://content-parser.com/markdown?url={encodeURIComponent(url) https://content-parser.com/markdown?url={encodeURIComponent(...}`.
- sjdz 4y agoThat's awesome, works really well! Good luck with it :)