3 ms·

Nah the AI won't replace coders or mathematicians until it can maintain codebases/knowledge long term. I actually don't think that current AI can replace any p

Nah the AI won't replace coders or mathematicians until it can maintain codebases/knowledge long term. I actually don't think that current AI can replace any profession that requires human interaction over many weeks. This is because imo they lack long term planning abilities

HarHarVeryFunny 20d ago
I also think they overestimate how much of most jobs can be done by an LLM (a text generator!), and how much importance and reliance most companies put into soft skills, and non-linguistic understanding/feels, both during interviewing (are they Googley-enough?) and afterwards. For example, how do you reconcile return-to-work mandates with the idea that companies are going to be happy with faceless remote workers? What does the boss do when the shit hits the fan and he would have yelled at people about the need to work all weekend, but instead all he has to yell at is an LLM that tells him he's "right to push back", that it promises not to delete the production database next time (except it will, because it can't learn), and that it could care less about being fired because it's just a calculator?
- vatsachak 20d ago
  Yeah. Not to mention the paper-clip maximizing that RL induces in them. I had 5.6-Luna use a parser combinator lib in order to find out that it imported it but wrote its own parser, so it technically followed my instructions. Imagine that paper-clip maximizing happening over millions of tasks. I think we are just entering the LLM + Human era.
  - HarHarVeryFunny 20d ago
    In a related vein, not too long ago I asked Sonnet how many states and non-terminals were in an a YACC parser for ANSI C, something that could easily be googled for, but it instead chose to go off and downloaded and build bison from source, downloaded a grammar, built the parser ... but then failed to give the answer since I'd hit my daily free limit. Got to admire the gung-ho approach I suppose ?
famouswaffles 20d ago
>Nah the AI won't replace coders or mathematicians until it can maintain codebases/knowledge long term. Okay...you understand that are training for this and it has gotten much much better at doing this over the years ? You should probably also understand that it doesn't need to be able to do this to cull the profession ?
- vatsachak 19d ago
  Yeah I use Astra Light at work. It's great but it probably cannot work on a project longer than a week without introducing architectural blunders

HarHarVeryFunny 20d ago

I also think they overestimate how much of most jobs can be done by an LLM (a text generator!), and how much importance and reliance most companies put into soft skills, and non-linguistic understanding/feels, both during interviewing (are they Googley-enough?) and afterwards. For example, how do you reconcile return-to-work mandates with the idea that companies are going to be happy with faceless remote workers? What does the boss do when the shit hits the fan and he would have yelled at people about the need to work all weekend, but instead all he has to yell at is an LLM that tells him he's "right to push back", that it promises not to delete the production database next time (except it will, because it can't learn), and that it could care less about being fired because it's just a calculator?

vatsachak 20d ago
Yeah. Not to mention the paper-clip maximizing that RL induces in them. I had 5.6-Luna use a parser combinator lib in order to find out that it imported it but wrote its own parser, so it technically followed my instructions. Imagine that paper-clip maximizing happening over millions of tasks. I think we are just entering the LLM + Human era.
- HarHarVeryFunny 20d ago
  In a related vein, not too long ago I asked Sonnet how many states and non-terminals were in an a YACC parser for ANSI C, something that could easily be googled for, but it instead chose to go off and downloaded and build bison from source, downloaded a grammar, built the parser ... but then failed to give the answer since I'd hit my daily free limit. Got to admire the gung-ho approach I suppose ?

famouswaffles 20d ago

>Nah the AI won't replace coders or mathematicians until it can maintain codebases/knowledge long term. Okay...you understand that are training for this and it has gotten much much better at doing this over the years ? You should probably also understand that it doesn't need to be able to do this to cull the profession ?

vatsachak 19d ago
Yeah I use Astra Light at work. It's great but it probably cannot work on a project longer than a week without introducing architectural blunders