3 ms·
ChatGPT can already generate almost working code. The obvious next step is to close the loop by replacing the human in RLHF with a compiler and unit tests. I th
by Jack000 4y ago
ChatGPT can already generate almost working code. The obvious next step is to close the loop by replacing the human in RLHF with a compiler and unit tests. I think for coding tasks this would fix most of the hallucination issues.
- lumost 4y agoMany of the hallucination issues seem to be chatgpt shorthand. It can only generate N chars, sometimes it makes up a function which doesn't exist but has a clear definition to get there. One of my coworkers has a phd in simd accelerated algorithms. We asked chatgpt to make an optimal simd sort. It did fine, except for declaring that our CPU provided a built in that doesn't exist. When I stated my CPU was an intel chip with avx512 and I needed an implementation of this function for avx512..it happily write the required assembler.