3 ms·
I can reliably produce hallucinations with this genre of prompt: "write a script that does <simple task> with <well known but not too-well-known API>." Even the
by hamdingers 5mo ago
I can reliably produce hallucinations with this genre of prompt: "write a script that does <simple task> with <well known but not too-well-known API>." Even the frontier models will hallucinate the perfect API endpoint that does exactly what I want, regardless of if it exists.
The fix is easy enough though, a line in my global AGENTS.md instructing agents to search/ask for documentation before working on API integrations.
- sapneshnaik 5mo agoYeah. Better to have more details in your prompt than fewer. For example, I use this: ``` Build a Nango sync that stores Figma projects. Integration ID: figma Connection ID for dry run: my-figma-connection Frequency: every hour Metadata: team_id Records: Project with id, name, last_modified API reference: https://www.figma.com/developers/api#projects-endpoints https://www.figma.com/developers/api#projects-endpoints ``` Note: You do need a Nango account and the Nango Skill installed before it could work.