3 ms·
Not a skeptic, I use AI for coding daily and am working on a custom agent setup because, through my experience for more than a year, they are not up to hard tas
by verdverm 1y ago
Not a skeptic, I use AI for coding daily and am working on a custom agent setup because, through my experience for more than a year, they are not up to hard tasks.
This is well known I thought, as even the people who build the AIs we use talk about this and acknowledge their limitations.
- comp_throw7 1y agoI'm pretty sure at this point more than half of Anthropic's new production code is LLM-written. That seems incompatible with "these agents are not up to the task of writing production level code at any meaningful scale".
- verdverm 1y agohow are you pretty sure? What are you basing that on? If true, could this explain why Anthropics APIs are less reliable than Gemini's? (I've never gotten a service overloaded response from Google like I did from Anthropic)
- versteegen 1y agoQuoting a month old post: https://www.lesswrong.com/posts/prSnGGAgfWtZexYLp/is-90-of-code-at-anthropic-being-written-by-ais https://www.lesswrong.com/posts/prSnGGAgfWtZexYLp/is-90-of-c... My current understanding (based on this text and other sources) is: - There exist some teams at Anthropic where around 90% of lines of code that get merged are written by AI, but this is a minority of teams. - The average over all of Anthropic for lines of merged code written by AI is much less than 90%, more like 50%. > I've never gotten a service overloaded response from Google like I did from Anthropic They're Google, they out-scale everyone. They run more than 1.3 quadrillion tokens per month through LLMs!