3 ms·

I have extremely high faith that the C compiler will produce very reliable x86 assembly code. I am extremely pessimistic that LLMs will ever reach that level o

• CamperBob2 2y ago
  What are some examples of prompts and responses that have made you pessimistic about the technology's ability to improve? Reliability has gotten insanely better over the past couple of years, and it's still improving.
  • BeetleB 2y ago
    > What are some examples of prompts and responses that have made you pessimistic about the technology's ability to improve? I'm not saying it won't improve. I think its lack of determinism puts a natural upper bound on reliability - something we don't have to worry about with compilers. As for examples: Oh wow. As much as I love and use them for coding, almost every project I work on has cases of coming up with complex solutions to a task that do not work, where 1-2 lines of (simple!) code would have solved the problem. It's not just that it fails, but it kept failing even after I told it how to do it right. Sometimes it does a great job and solves a hard problem for me. Other times I lose a lot of time getting it to do beginner level stuff. It has huge gaps/blind spots.