Because, to be blunt, I think this is total bullshit if you're using a decent model: "I've even caught it literally writing the wrong algorithm when asked to i

Because, to be blunt, I think this is total bullshit if you're using a decent model: "I've even caught it literally writing the wrong algorithm when asked to implement a specific and well known algorithm. For example, asking it "write a selection sort" and watching it write a bubble sort instead. No amount of re-prompts pushes it to the right algorithm in those cases either, instead it'll regenerate the same wrong algorithm over and over."