4 ms·

>brute force search of the solution space “Brute force” is mostly what makes it all work, and what is most disappointing to me currently. Including the brute f

by Isamu 8mo ago

>brute force search of the solution space “Brute force” is mostly what makes it all work, and what is most disappointing to me currently. Including the brute force necessary to train an LLM, the vast quantity of text necessary to approach almost human quality, the massive scale of data centers necessary to deploy these models, etc. I am hoping this is a transitional period, where LLMs could be used to create better models that are more finesse and less brute force.

martin-t 8mo ago
To be honest, these models being bad is what gives me some hope we can figure out how to approach a potential future AI as a society before it arrives. Because right now everything in the west is structured around rich people owning things they have not built while people who did the actual work with their hands and their minds are left in the dust. For a brief period of time (a couple decades), tech was a path for anyone from any background to get at least enough to not struggle. Not become truly rich as for that you need to own real estate or companies but having all your reasonable material needs taken care of and being able to save up for retirement (or in countries without free education, to pay for kids' college). And that might be coming to an end, with people who benefited from this opportunity cheering it on.
- logicprog 8mo ago
  I make $1500/mo, working part time for a friend being vastly underpaid for technical work and part time as a meat packer in the back of a supermarket, because I had to drop out of university a year before finishing due to a disability and loss of financial resources, and thanks to being trans, disabled, and a dropout, as well as the job market that's fucked up due to AI and all the other reasons for layoffs, so I can't get a tech job, despite having been programming since I was seven and being very good at it. I don't think it's really fair to talk about "people who benefited from this opportunity cheering it on" in the comments on one of my posts. I'm an agentic AI coding enthusiast because I find it fascinating, it allows me to focus more on what I like most about programming (software architecture, systems thinking, etc), and the decreased cognitive load and increased productivity allows me to continue to do interesting projects in the time and energy I have left after my jobs and disability take.
  - martin-t 8mo ago
    The current crop of genML criticism is a false dichotomy. People either focus on the models not meeting their standards (which is very subject matter dependent) or being exploitative. The thing is, both can be true at the same time and the models can in theory get good enough. Just like the water usage argument - I am not saying it's right or wrong, I am saying it can change if somebody comes up with more energy efficient models. We should focus on the fundamentals. And those are that LLMs are build on the work of millions (hundreds of millions?) of people without their consent and that their goal is to reduce or completely eliminate the economic (and therefore political) power of those people. I understand why you do it, I use stolen code too because ultimately nobody is likely to be punished and I'd just be disadvantaging myself for no reason. But we need to think about the endgame - not ours - theirs - because theirs dictates ours.

by Isamu 8mo ago

martin-t 8mo ago

To be honest, these models being bad is what gives me some hope we can figure out how to approach a potential future AI as a society before it arrives. Because right now everything in the west is structured around rich people owning things they have not built while people who did the actual work with their hands and their minds are left in the dust. For a brief period of time (a couple decades), tech was a path for anyone from any background to get at least enough to not struggle. Not become truly rich as for that you need to own real estate or companies but having all your reasonable material needs taken care of and being able to save up for retirement (or in countries without free education, to pay for kids' college). And that might be coming to an end, with people who benefited from this opportunity cheering it on.

logicprog 8mo ago
I make $1500/mo, working part time for a friend being vastly underpaid for technical work and part time as a meat packer in the back of a supermarket, because I had to drop out of university a year before finishing due to a disability and loss of financial resources, and thanks to being trans, disabled, and a dropout, as well as the job market that's fucked up due to AI and all the other reasons for layoffs, so I can't get a tech job, despite having been programming since I was seven and being very good at it. I don't think it's really fair to talk about "people who benefited from this opportunity cheering it on" in the comments on one of my posts. I'm an agentic AI coding enthusiast because I find it fascinating, it allows me to focus more on what I like most about programming (software architecture, systems thinking, etc), and the decreased cognitive load and increased productivity allows me to continue to do interesting projects in the time and energy I have left after my jobs and disability take.
- martin-t 8mo ago
  The current crop of genML criticism is a false dichotomy. People either focus on the models not meeting their standards (which is very subject matter dependent) or being exploitative. The thing is, both can be true at the same time and the models can in theory get good enough. Just like the water usage argument - I am not saying it's right or wrong, I am saying it can change if somebody comes up with more energy efficient models. We should focus on the fundamentals. And those are that LLMs are build on the work of millions (hundreds of millions?) of people without their consent and that their goal is to reduce or completely eliminate the economic (and therefore political) power of those people. I understand why you do it, I use stolen code too because ultimately nobody is likely to be punished and I'd just be disadvantaging myself for no reason. But we need to think about the endgame - not ours - theirs - because theirs dictates ours.