4 ms·

> It's not enterprise-grade software, but it's not a CRUD app with thousands of examples in github, either. Optimization is a very simple problem though. Main

by fmbb 9mo ago

> It's not enterprise-grade software, but it's not a CRUD app with thousands of examples in github, either. Optimization is a very simple problem though. Maintaining a random CRUD app from some startup is harder work.

matwood 9mo ago
> Optimization is a very simple problem though. C'mon, there's post every other week that optimization never happens anymore because it's too hard. If AI can take all the crap code humans are writing and make it better, that sounds like a huge win.
- nothrabannosir 9mo ago
  Simple is the opposite of complex; the opposite of hard is easy. They are orthogonal. Chess is simple and hard. Go is simpler and harder than chess. Program optimization problems are less simple than both, but still simpler than free-form CRUD apps with fuzzy, open ended acceptance criteria. It would stand to reason an autonomous agent would do well at mathematically challenging problems with bounded search space and automatically testable and quantifiable output. (Not GP but I assume that's what they were getting at)
- dns_snek 9mo ago
  > If AI can take all the crap code humans are writing and make it better, that sounds like a huge win. This sort of misunderstanding of achievements is what keeps driving the AI mania. The AI generated an algorithm for optimizing a well-defined, bounded mathematical problem that marginally beat the human-written algorithms. This AI can't do what you're hyping it up to do because software optimization is a different kind of optimization problem - it's complex, underspecified, and it doesn't have general algorithmic solutions. LLM may play a significant role in optimizing software some day but it's not going to have much in common with optimization in a mathematical sense so this achievement doesn't get us any closer to that goal.
lazyasciiart 9mo ago
The argument was about “non-trivial”. Are you calling this work trivial or not?

by fmbb 9mo ago

matwood 9mo ago

> Optimization is a very simple problem though. C'mon, there's post every other week that optimization never happens anymore because it's too hard. If AI can take all the crap code humans are writing and make it better, that sounds like a huge win.

nothrabannosir 9mo ago
Simple is the opposite of complex; the opposite of hard is easy. They are orthogonal. Chess is simple and hard. Go is simpler and harder than chess. Program optimization problems are less simple than both, but still simpler than free-form CRUD apps with fuzzy, open ended acceptance criteria. It would stand to reason an autonomous agent would do well at mathematically challenging problems with bounded search space and automatically testable and quantifiable output. (Not GP but I assume that's what they were getting at)
dns_snek 9mo ago
> If AI can take all the crap code humans are writing and make it better, that sounds like a huge win. This sort of misunderstanding of achievements is what keeps driving the AI mania. The AI generated an algorithm for optimizing a well-defined, bounded mathematical problem that marginally beat the human-written algorithms. This AI can't do what you're hyping it up to do because software optimization is a different kind of optimization problem - it's complex, underspecified, and it doesn't have general algorithmic solutions. LLM may play a significant role in optimizing software some day but it's not going to have much in common with optimization in a mathematical sense so this achievement doesn't get us any closer to that goal.

lazyasciiart 9mo ago

The argument was about “non-trivial”. Are you calling this work trivial or not?