3 ms·

Yeah LLMs get me _an_ answer far faster than I could find it myself, but it's often not correct. And then I have to verify it myself which was exactly the work

Yeah LLMs get me _an_ answer far faster than I could find it myself, but it's often not correct. And then I have to verify it myself which was exactly the work I was trying to skip by using the LLM to start with. If I have to manually verify every answer, I may as well read the docs myself.

Onawa 1y ago
It doesn't completely solve this problem but definitely helps to have something like context7 MCP server running that `Copilot et al.` can reach dramatically reduces hallucinations for most tools. And additionally I've used Continue.dev VSCode along with manually specified docs and guides that you can selectively inject into your context. Both of those tactics make a huge difference in answer quality.
emodendroket 1y ago
Is it really that different from scrolling through Stack Overflow answers and rejecting the ones that aren't suitable? A lot of times you can tell it what specifically you didn't like about the solution and get another crack anyway (e.g., "let's iterate over the characters to do this rather than using a regex")
- mrkeen 1y ago
  It's a little different. You pay money, have vendor lock-in, get one answer, and there's no upvotes/downvotes/accepted-answers/moderation or clarification.
- sotix 1y ago
  I wasn't using stack overflow before LLMs. It had already declined too much in quality and discouraged me from posting legitimate questions on there. I was more focused on reading documentation to gain a solid understanding. So for me, it's a much different experience. It's incredible how quickly an LLM can answer. I've also crossed checked its responses with documentation before and discovered that it suggested implementing a deprecated feature that had a massive warning banner in the documentation that the LLM failed to indicate. I'm still a fan of reading documentation.
- HankStallone 1y ago
  I've asked AIs for help in doing things in Salesforce, and the answers tend to be a 50/50 mix of correct steps and garbage. It's not hard to see why, because there's a lot of garbage on support sites, much of it because it's outdated. Garbage in, garbage out. The difference is that if I go directly to the support site, there's a decent chance I can quickly spot and reject the garbage based on the date, the votes it's gotten, even the quality of the writing. AI doesn't include any of those clues; it mixes good and bad together and offers it up for me to pick apart through trial and error.
  - jdiff 1y ago
    Lot of support sites are AI generated themselves now. Lenovo's support site is absolute garbage, it has entire articles dedicated to explaining how to use your laptop's screen as a monitor by setting the HDMI to INPUT instead of OUTPUT, something flatly not possible on any laptop. Also mentions VGA and DVI in 2025, something no laptop they sell features.

Onawa 1y ago

It doesn't completely solve this problem but definitely helps to have something like context7 MCP server running that `Copilot et al.` can reach dramatically reduces hallucinations for most tools. And additionally I've used Continue.dev VSCode along with manually specified docs and guides that you can selectively inject into your context. Both of those tactics make a huge difference in answer quality.

emodendroket 1y ago

Is it really that different from scrolling through Stack Overflow answers and rejecting the ones that aren't suitable? A lot of times you can tell it what specifically you didn't like about the solution and get another crack anyway (e.g., "let's iterate over the characters to do this rather than using a regex")

mrkeen 1y ago
It's a little different. You pay money, have vendor lock-in, get one answer, and there's no upvotes/downvotes/accepted-answers/moderation or clarification.
sotix 1y ago
I wasn't using stack overflow before LLMs. It had already declined too much in quality and discouraged me from posting legitimate questions on there. I was more focused on reading documentation to gain a solid understanding. So for me, it's a much different experience. It's incredible how quickly an LLM can answer. I've also crossed checked its responses with documentation before and discovered that it suggested implementing a deprecated feature that had a massive warning banner in the documentation that the LLM failed to indicate. I'm still a fan of reading documentation.
HankStallone 1y ago
I've asked AIs for help in doing things in Salesforce, and the answers tend to be a 50/50 mix of correct steps and garbage. It's not hard to see why, because there's a lot of garbage on support sites, much of it because it's outdated. Garbage in, garbage out. The difference is that if I go directly to the support site, there's a decent chance I can quickly spot and reject the garbage based on the date, the votes it's gotten, even the quality of the writing. AI doesn't include any of those clues; it mixes good and bad together and offers it up for me to pick apart through trial and error.
- jdiff 1y ago
  Lot of support sites are AI generated themselves now. Lenovo's support site is absolute garbage, it has entire articles dedicated to explaining how to use your laptop's screen as a monitor by setting the HDMI to INPUT instead of OUTPUT, something flatly not possible on any laptop. Also mentions VGA and DVI in 2025, something no laptop they sell features.