4 ms·

I think society will quickly adjust. I've already updated my interview questions, teachers will update their homework assignments, etc. Eventually it'll just

I think society will quickly adjust. I've already updated my interview questions, teachers will update their homework assignments, etc. Eventually it'll just be another productivity tool.

t_mann 2y ago
Are you in the "it's just like with calculators" camp? I think there's a fundamental difference between a tool that just simplifies some very specific solution steps vs a tool that takes the literal assignment question, regardless of how "updated" or "more difficult" it is, and outputs an answer that you can probably submit without even checking for a passing grade. Watermarking, guardrailing etc. won't fundamentally fix this, there will always be access to more unfiltered models.
- Tade0 2y ago
  You can always run your questions through an LLM and only use those which spew nonsense most of the time. Cheaters, by definition, avoid real work, so they won't be using custom models unless the stakes are sufficiently high.
  - t_mann 2y ago
    > Cheaters, by definition, avoid real work, so they won't be using custom models unless the stakes are sufficiently high. I think it's a non-sequitur, some might get more enjoyment out of tinkering with LLMs than out of whatever the assignment is asking you to do. But even if you don't believe that, it should be obvious that the ones using the tool needn't be the same as the ones putting in the work.
itishappy 2y ago
How have you updated your interview questions?
- blitzar 2y ago
  Hey chatgpt, write me interview questions.
lm28469 2y ago
"It'll just automagically solve itself" Techno-solutionism truly is a sect at this point This isn't yet another "we need to change a few things at the tail end" problem like internet was. You have people getting in higher education with barely any skills whatsoever, not even the basics to just get by Education was already not in good shape in the west, COVID made it worse and now we get LLMs. https://www.gisreportsonline.com/r/worsening-2022-pisa-tests-results-oecd/ https://www.gisreportsonline.com/r/worsening-2022-pisa-tests... It's going to be a major issue, especially in a world that requires higher and higher education, coupled with systems which are more and more complex, and fragile. Internet was supposed to make everyone smarter, we quickly discovered that information != intelligence, let's see how it goes for LLM but if anything it'll make use even more dependent on technology. And couple that with teens spending on average 5 hours per day on social media... I sometimes watch archive footage of kids answering questions in school in the 70s vs now, and it's painfully obvious that the level plummeted, the average kid back then was more eloquent than most young adults today
- skulk 2y ago
  > It's going to be a major issue, especially in a world that requires higher and higher education Society will bifurcate further; as mental labor is offloaded to GPUs, the demand for education will drop. A greater percentage of the workforce will be doing manual labor, and that doesn't really require much of an education at all. Those with means will have access to a proper education as always, but that group of people is going to shrink.
  - lm28469 2y ago
    I'm not even sure about that, there isn't even that much unskilled manual labor left.

I think society will quickly adjust. I've already updated my interview questions, teachers will update their homework assignments, etc. Eventually it'll just be another productivity tool.

t_mann 2y ago

Are you in the "it's just like with calculators" camp? I think there's a fundamental difference between a tool that just simplifies some very specific solution steps vs a tool that takes the literal assignment question, regardless of how "updated" or "more difficult" it is, and outputs an answer that you can probably submit without even checking for a passing grade. Watermarking, guardrailing etc. won't fundamentally fix this, there will always be access to more unfiltered models.

Tade0 2y ago
You can always run your questions through an LLM and only use those which spew nonsense most of the time. Cheaters, by definition, avoid real work, so they won't be using custom models unless the stakes are sufficiently high.
- t_mann 2y ago
  > Cheaters, by definition, avoid real work, so they won't be using custom models unless the stakes are sufficiently high. I think it's a non-sequitur, some might get more enjoyment out of tinkering with LLMs than out of whatever the assignment is asking you to do. But even if you don't believe that, it should be obvious that the ones using the tool needn't be the same as the ones putting in the work.

itishappy 2y ago

How have you updated your interview questions?

blitzar 2y ago
Hey chatgpt, write me interview questions.

lm28469 2y ago

"It'll just automagically solve itself" Techno-solutionism truly is a sect at this point This isn't yet another "we need to change a few things at the tail end" problem like internet was. You have people getting in higher education with barely any skills whatsoever, not even the basics to just get by Education was already not in good shape in the west, COVID made it worse and now we get LLMs. https://www.gisreportsonline.com/r/worsening-2022-pisa-tests-results-oecd/ https://www.gisreportsonline.com/r/worsening-2022-pisa-tests... It's going to be a major issue, especially in a world that requires higher and higher education, coupled with systems which are more and more complex, and fragile. Internet was supposed to make everyone smarter, we quickly discovered that information != intelligence, let's see how it goes for LLM but if anything it'll make use even more dependent on technology. And couple that with teens spending on average 5 hours per day on social media... I sometimes watch archive footage of kids answering questions in school in the 70s vs now, and it's painfully obvious that the level plummeted, the average kid back then was more eloquent than most young adults today

skulk 2y ago
> It's going to be a major issue, especially in a world that requires higher and higher education Society will bifurcate further; as mental labor is offloaded to GPUs, the demand for education will drop. A greater percentage of the workforce will be doing manual labor, and that doesn't really require much of an education at all. Those with means will have access to a proper education as always, but that group of people is going to shrink.
- lm28469 2y ago
  I'm not even sure about that, there isn't even that much unskilled manual labor left.