3 ms·
When I iterate code through LLM's, it add copious amounts of comments to the code, and iteratively, the comments can become quite excessive and lead to false be
by SubiculumCode 1y ago
When I iterate code through LLM's, it add copious amounts of comments to the code, and iteratively, the comments can become quite excessive and lead to false beliefs by the evaluating LLM....to the point where the comments convincing the LLM that the code is right, even when it is not. Too often, LLM will regurgitate the over the top claims in a source document when asked to evaluate the source document.
That is a serious problem for peer review. We shouldn't set ourselves up for rewarding unfounded boasting in grant applications.