4 ms·

Right now, being able to efficiently extract value from AI based code generation tools requires supervision at some extent - e.g. A competent developer that is

Right now, being able to efficiently extract value from AI based code generation tools requires supervision at some extent - e.g. A competent developer that is able to validade the output; As the industry moves toward these systems, so do the hiring requirements - there is little to no incentive to hire more junior devs (as they lack the experience of building software), effectively killing the entry-level jobs that would someday generate those competent developers. The thing is, part of the reason AI requires supervision is because it's producing human-maintainable output in languages oriented for human generation; It is my belief we're at a reality akin to the surgence of the first programming langages - a mimick that allows humans to abstract away machine details and translate high-level concepts into machine language. It is also my belief that the next step are specialized AI languages, that will remove most of the human element, as an optimization. Sure, there will always the need for meatbags, but big companies will hire tens, not thousands.

cma 2y ago
Alternatively, junior devs with ai web search and ai explanations are able to learn much faster and not bother senior devs with compiler error puzzles.
- hooverd 2y ago
  > are able to but they won't. they'll just give up if the auto-complete doesn't fix it for them.
- n_ary 2y ago
  But if those aspiring juniors stop asking those questions and the seniors not answer them in open web, neither LLMs nor juniors have new training data and both become stagnated. How do we solve this? At my early days, I learned more reading code from much senior engineers and began to appreciate it. An effective seasoned senior writes a beautiful poetry that conveys deeper meaning and solves the entertainment(erm… business requirement) purpose. If the seniors retire and the juniors are no longer hired, then where do LLMs get new data from? In all sense of things, I suspect we’ll see more juniors getting hired in coming years and few seniors present to guide them, same as how we previously had few db specialists and architects giving out the outline and the followers made those into actual products.
  - aforwardslash 2y ago
    The way forward I see is a path to autonomous development; human development is boutique dev or supervision; a good example are x86-64 assembly skills today. The gross of dev will be handled by AI, specially the mindless crud stuff with browser integration. When you skip the whole intermediate language and/or can generate a high level binary definition spec that can be compiled, its game over. Development as we know it is dead, and people will target intermediate ai-solvable code, as they do today to satisfy various pipelines such as testing or cyclomatic complexity.
- aforwardslash 2y ago
  Why should a company pay X for a guy that will take 10 years to understand how apps fail, when he can just hire a guy at X2 or X3? Specially if in 3-5 years, you can skip the guys altogether?
1shooner 2y ago
I heard an OpenAI engineer give an eye-opening perspective that went something like: anything above machine code is an abstraction for the benefit of the humans that need to maintain it. If you don't need humans to understand it, you don't need your functionality in higher-level languages at all. The AI will just brute-force those abstractions.
- soulofmischief 2y ago
  I don't buy into it. The benefits of abstraction hold for machines, as they can spend less bandwidth when modeling, using and modifying a system, and error is minimized during long, repetitive operations. Abstraction can be thought of as a system of interfaces. The right abstractions can totally transform how a human or machine interpret and solve a problem. The most effective and elegant machines will still make use of abstraction above machine code.
  - aforwardslash 2y ago
    Many modern compilers already do this - they generate intermediate code, and then a specialized binary is generated. Why couldn't an LLM generate intermediate code directly?
    - soulofmischief 2y ago
      Again, abstraction allows for domain-specific language which shapes the way a problem is interpreted and solved. Perspective is everything, and it's hard to have perspective of the entire system on the ground floor. Getting the priors right, or getting the LLM to first consider different grammars can greatly simplify the problem and its solution. You can think of learning as decontextualization of input data into pure relational constructs. Application, then, is the recontextualization of some relational construct in order to apply generalized relations and insights to problems of different shapes and sizes. Understanding a concept thus means mastering the decontextualization and recontextualization of a set of relations. Using a DSL instead of pure machine code is an example of recontextualization, and it can totally change how a model understands and processes input and what kind of output is produced.
lurking_swe 2y ago
so what happens when the AI makes a mistake, how do you debug it or fix it if it’s not in an abstraction useful to a human?

cma 2y ago

Alternatively, junior devs with ai web search and ai explanations are able to learn much faster and not bother senior devs with compiler error puzzles.

hooverd 2y ago
> are able to but they won't. they'll just give up if the auto-complete doesn't fix it for them.
n_ary 2y ago
But if those aspiring juniors stop asking those questions and the seniors not answer them in open web, neither LLMs nor juniors have new training data and both become stagnated. How do we solve this? At my early days, I learned more reading code from much senior engineers and began to appreciate it. An effective seasoned senior writes a beautiful poetry that conveys deeper meaning and solves the entertainment(erm… business requirement) purpose. If the seniors retire and the juniors are no longer hired, then where do LLMs get new data from? In all sense of things, I suspect we’ll see more juniors getting hired in coming years and few seniors present to guide them, same as how we previously had few db specialists and architects giving out the outline and the followers made those into actual products.
- aforwardslash 2y ago
  The way forward I see is a path to autonomous development; human development is boutique dev or supervision; a good example are x86-64 assembly skills today. The gross of dev will be handled by AI, specially the mindless crud stuff with browser integration. When you skip the whole intermediate language and/or can generate a high level binary definition spec that can be compiled, its game over. Development as we know it is dead, and people will target intermediate ai-solvable code, as they do today to satisfy various pipelines such as testing or cyclomatic complexity.
aforwardslash 2y ago
Why should a company pay X for a guy that will take 10 years to understand how apps fail, when he can just hire a guy at X2 or X3? Specially if in 3-5 years, you can skip the guys altogether?

1shooner 2y ago

I heard an OpenAI engineer give an eye-opening perspective that went something like: anything above machine code is an abstraction for the benefit of the humans that need to maintain it. If you don't need humans to understand it, you don't need your functionality in higher-level languages at all. The AI will just brute-force those abstractions.

soulofmischief 2y ago
I don't buy into it. The benefits of abstraction hold for machines, as they can spend less bandwidth when modeling, using and modifying a system, and error is minimized during long, repetitive operations. Abstraction can be thought of as a system of interfaces. The right abstractions can totally transform how a human or machine interpret and solve a problem. The most effective and elegant machines will still make use of abstraction above machine code.
- aforwardslash 2y ago
  Many modern compilers already do this - they generate intermediate code, and then a specialized binary is generated. Why couldn't an LLM generate intermediate code directly?
  - soulofmischief 2y ago
    Again, abstraction allows for domain-specific language which shapes the way a problem is interpreted and solved. Perspective is everything, and it's hard to have perspective of the entire system on the ground floor. Getting the priors right, or getting the LLM to first consider different grammars can greatly simplify the problem and its solution. You can think of learning as decontextualization of input data into pure relational constructs. Application, then, is the recontextualization of some relational construct in order to apply generalized relations and insights to problems of different shapes and sizes. Understanding a concept thus means mastering the decontextualization and recontextualization of a set of relations. Using a DSL instead of pure machine code is an example of recontextualization, and it can totally change how a model understands and processes input and what kind of output is produced.

lurking_swe 2y ago

so what happens when the AI makes a mistake, how do you debug it or fix it if it’s not in an abstraction useful to a human?