4 ms·
Show HN: I built an API for agents visiting my personal website
- selvmvde 5mo ago[flagged]
- dormento 5mo ago> Why your website is invisible to the agents visiting it. I only _wish_ I could make a website invisible to agents. Instead now we're hostages to Cloudflare /shrug Edit: so this isn't as "driveby-ish": the tldr; seems to be, if you want your site crawl-able, don't go overboard on the JS. This was good wisdom back then just as it is now in the current situation.
- jpkt 5mo agoI have been using llms.txt for that
- joao_sobhie 5mo agoI really don't know why he did this, his website has llms.txt
- selvmvde 5mo agoFair point on llms.txt, but I think we're talking about two different layers here; llms.txt helps agents find content -> API helps agents collaborate with a human
- joao_sobhie 5mo agoGot you. You made me realize something. I've been developing a scraping api and after reading your post I tried to do the same as you did. First I've asked claude about the company, the services and prices. Than I've used the api to test if the response is the same and It's not. Basiclly using the api I got thinks that just asking claude, didn't show. The difference is that api turn the website into markdown and don't see the llms.txt. Using api looks like the AI understand the company as a whole. Thanks for sharing that experiment, you gave me a good ideia on creating a brain for my scenario. I'm thinking of use Obsidian as the brain, and use my scraping api to colect the data from my company website, linkedin and instagram. With all the knoledge, use paperclip to orchestrate marketing, projects, fixes. I will build that.
- selvmvde 5mo ago[dead]
- devansh0718 5mo agoi think its better use llms.txt for this
- zenvesto 5mo ago[dead]
- selvmvde 5mo ago[flagged]
- solomaker282 5mo ago[flagged]