3 ms·

Recently I tried to scaffold a website with a well known coding agent. It didn’t work. I asked a colleague. He had the same problem. Turned out it was using ou

Recently I tried to scaffold a website with a well known coding agent. It didn’t work. I asked a colleague. He had the same problem. Turned out it was using out of date setup instructions for a major tool that has changed post training. After spending time fixing the problem, I realised (1) it would have been faster to do it myself and (2) I can no longer trust that tool to set anything up - what if it’s doing something else wrong?

com2kid 1y ago
You'd run into the same issues if you followed a slightly outdated medium tutorial on the topic! React had this issue when they changed away from create react app. Basically every tutorial for years was instantly made obsolete, despite occupying all the top search results slots. Forums where filled with confusion for quite awhile. Now days most libraries seem to rely on "content producers" to document how to actually do things and don't bother with great docs filled with examples. In decades gone past, companies would hire actual authors to write real physical books on how to use new APIs. LLMs just have a higher latency on updating their reference material.
- rhubarbtree 1y ago
  > You'd run into the same issues if you followed a slightly outdated medium tutorial on the topic! You’re right, and in the past I have. So I know to always check the authorities sources for setup instructions.
paool 1y ago
Sorry to say, but skill issue. Use MCP servers, specifically context 7. This gets up to date docs as long as you include the library name on your prompt and ask to use context 7. You did the equivalent of raw dogging gpt4(an old model) for recent news versus using an agent with web search tooling.
- margalabargala 1y ago
  "My shitty company's shitty app has an API for that! It's so good sales has decided to present it to the industry as though it should be incorrect not to use it"

com2kid 1y ago

You'd run into the same issues if you followed a slightly outdated medium tutorial on the topic! React had this issue when they changed away from create react app. Basically every tutorial for years was instantly made obsolete, despite occupying all the top search results slots. Forums where filled with confusion for quite awhile. Now days most libraries seem to rely on "content producers" to document how to actually do things and don't bother with great docs filled with examples. In decades gone past, companies would hire actual authors to write real physical books on how to use new APIs. LLMs just have a higher latency on updating their reference material.

rhubarbtree 1y ago
> You'd run into the same issues if you followed a slightly outdated medium tutorial on the topic! You’re right, and in the past I have. So I know to always check the authorities sources for setup instructions.

paool 1y ago

Sorry to say, but skill issue. Use MCP servers, specifically context 7. This gets up to date docs as long as you include the library name on your prompt and ask to use context 7. You did the equivalent of raw dogging gpt4(an old model) for recent news versus using an agent with web search tooling.

margalabargala 1y ago
"My shitty company's shitty app has an API for that! It's so good sales has decided to present it to the industry as though it should be incorrect not to use it"