3 ms·
SiteView – A Good HTML to Markdown Converter Powered by AI
- jaygray0919 3y agoDoes this work if an HTML page is on a Cloudflare network? My experiment returns the message: An unknown error occurred while rendering the page.
- Woshiwuja 3y agoCant get it to work, tried even with google but its always a cloudflare error...
- solidgoldmagik 3y agotried it on a bunch of random sites (news articles, github repos, company home pages, etc) and seems to work for me.
- jaygray0919 3y agoPlease show a successful query. For example, here is a test query: curl -d POST https://api.siteview.app https://api.siteview.app {"url": "https://lite.cnn.com https://lite.cnn.com"}
- solidgoldmagik 3y ago{ "url": "https://wework.com https://wework.com" } { "url": "https://www.cnn.com/2023/11/08/politics/takeaways-republican-debate/index.html https://www.cnn.com/2023/11/08/politics/takeaways-republican..." } { "url": "https://pytorch.org https://pytorch.org" } { "url": "https://www.natesilver.net/p/160-million-americans-are-eligible https://www.natesilver.net/p/160-million-americans-are-eligi..." }
- jaygray0919 3y agoHere is another part of the response: <span class="cf-footer-item sm:block sm:mb-1">Cloudflare Ray ID: <strong class="font-semibold">8236b959ba542980</strong></span>
- jaygray0919 3y agoNote: i was running a VPN but turned it off for the experiment - thinking that something is causing a network redirect
- Woshiwuja 3y agoI dont think it was the vpn. Tried again with the same command and it worked. Im guessing it was just a bit overloaded because of this post
- jaygray0919 3y agoWhen testing the wework link i get this message: `<title>Worker threw exception | api.siteview.app | Cloudflare</title> (more ...)`. Does curl need additional information to escape this type of response? Do you use a curl alternative?
- solidgoldmagik 3y agoare you passing the `content-type: application/json` header? I just now ran the wework and it worked as expected
- jaygray0919 3y agoHere is my string: curl -H 'Content-Type: application/json' -d POST https://api.siteview.app https://api.siteview.app { "url": "https://wework.com https://wework.com" }. Do you see a problem with that request (because i am receiving the same Cloudflare message)
- solidgoldmagik 3y agoChatGPT said this is the correct cURL syntax: ``` curl -X POST https://api.siteview.app https://api.siteview.app -H 'Content-Type: application/json' -d '{ "url": "https://wework.com https://wework.com" }' ```
- jaygray0919 3y agoGot it. works well. a very useful tool.