4 ms·
What I'm seeing is a little eternal September of support tickets about programs that fail to interface the JSON API of a customer of mine. The API is always all
by pmontra 5mo ago
What I'm seeing is a little eternal September of support tickets about programs that fail to interface the JSON API of a customer of mine. The API is always allucinated. In the best case there are out of place attributes. Often they don't exist at all. I've seen x, y, width, height when we have only top and left. Of course no human read the documentation. Those are probably founders vibe coding a client without the technical competence of understanding the API doc on Postman. That is understandable. Unfortunately they don't even have the competence of pointing their AI to Postman in the right way. My custumer assessed that they will always find a way to do a mistake despite any mitigation from our side. What I do is replying to those tickets with line by line comments of the allucinated JSON. I never talk about AIs because I might hurt the pride of some of them and, who knows, some little mistakes could be from real junior developers. Sometimes the tickets are followed up by more puzzled ones, sometimes they fix the problem. Probably they copy and paste my reply to their bots.
- jeffrallen 5mo ago> Probably they copy and paste my reply to their bots. You must not give in to the temptation to mention pirate talk, Klingon, or goblins. But now that I've put the seed in your mind, you probably (hopefully) will. :)
- Scroll_Swe 5mo agoSeeing this too. Customer support tickets are all AI now. The random bolded words, the em dashes, they way where if you KNOW what is actually happening, they are slightly off or just WAY off.
- ricardobayes 5mo agoI've heard the same thing mentioned by a close friend building integrations. They are helping/supporting real use cases but they decided not to help vibe coder founders without an understanding of how APIs work etc. It's just too big of a gap to cover even for larger companies with strong support.
- __s 5mo agoIf you were tapped into AI first features you'd design aliases in your api so AI hallucinated api exists for next time
- leesalminen 5mo agoCreate a <domain>.tld/llms.txt or some SKILL.md files. When I encounter these tickets I just share links to these resources and the problem goes away.
- winrid 5mo agoThat's why I made an API LLMs can call to search fastcomments APIs: https://docs.fastcomments.com/guide-llm-kit.html https://docs.fastcomments.com/guide-llm-kit.html