17 ms·

Also selectors and taffy. It's also using weirdly old versions of some dependencies (e.g. wgpu 0.17 from June 2023 when the latest is 28 released in Decemeber

Also selectors and taffy. It's also using weirdly old versions of some dependencies (e.g. wgpu 0.17 from June 2023 when the latest is 28 released in Decemeber 2025)

satvikpendem 9mo ago
That is because I've noticed the AI just edits the version management files (package.json, cargo.toml, etc) directly instead of using the build tool (npm add, cargo add), so it always hallucinates a random old version that's found in its training set. I explicitly have to tell the AI to use the build tool whenever I use AI.
- arresin 9mo ago
  It’s interesting that they don’t even know this
  - notatallshaw 9mo ago
    I assume lock and dependency files are in the training data, so predicting version number tokens have high probabilities associated with them.
- computerex 9mo ago
  I was LITERALLY thinking the other day of a niche tool for engineers to help them discover and fix this in the future because at the rate I have seen models version lock dependencies I thought this is going to be a big problem in the future.
  - deleted 9mo ago
    [deleted]
  - satvikpendem 9mo ago
    Just use Dependi or similar VSCode extensions, they'll tell you if dependencies are outdated.
  - mikestorrent 9mo ago
    Bigger companies have vulnerability and version management toolsets like Snyk, Cycode, etc. to help keep things up to date at scale across lots of repos.
  - ljm 9mo ago
    You can do prompt injection through versions. The LLM would go back to GitHub in its endless attempt to people please, but dependency managers would ignore it for being invalid.
  - solid_fuel 9mo ago
    No need to build a tool for it, engineers can avoid the whole issue by simply avoiding slop-spewing code generation tools. Hell, just never allow an LLM to modify the dependency configuration - if you want to use a library, choose and import it yourself. Like an engineer.
    - callc 9mo ago
      Proposal to not tarnish the good name of actual engineers: slopgineers. Maybe LLemgineers? Slopgrammers?

Also selectors and taffy. It's also using weirdly old versions of some dependencies (e.g. wgpu 0.17 from June 2023 when the latest is 28 released in Decemeber 2025)

satvikpendem 9mo ago

That is because I've noticed the AI just edits the version management files (package.json, cargo.toml, etc) directly instead of using the build tool (npm add, cargo add), so it always hallucinates a random old version that's found in its training set. I explicitly have to tell the AI to use the build tool whenever I use AI.

arresin 9mo ago
It’s interesting that they don’t even know this
- notatallshaw 9mo ago
  I assume lock and dependency files are in the training data, so predicting version number tokens have high probabilities associated with them.
computerex 9mo ago
I was LITERALLY thinking the other day of a niche tool for engineers to help them discover and fix this in the future because at the rate I have seen models version lock dependencies I thought this is going to be a big problem in the future.
- deleted 9mo ago
  [deleted]
- satvikpendem 9mo ago
  Just use Dependi or similar VSCode extensions, they'll tell you if dependencies are outdated.
- mikestorrent 9mo ago
  Bigger companies have vulnerability and version management toolsets like Snyk, Cycode, etc. to help keep things up to date at scale across lots of repos.
- ljm 9mo ago
  You can do prompt injection through versions. The LLM would go back to GitHub in its endless attempt to people please, but dependency managers would ignore it for being invalid.
- solid_fuel 9mo ago
  No need to build a tool for it, engineers can avoid the whole issue by simply avoiding slop-spewing code generation tools. Hell, just never allow an LLM to modify the dependency configuration - if you want to use a library, choose and import it yourself. Like an engineer.
  - callc 9mo ago
    Proposal to not tarnish the good name of actual engineers: slopgineers. Maybe LLemgineers? Slopgrammers?