7 ms·

As a former educator, I look forward to the day that we can simply track student ability in a trustable manner based on long term data collection in the classro

As a former educator, I look forward to the day that we can simply track student ability in a trustable manner based on long term data collection in the classroom rather than requiring these additional, often expensive, exams. We would need to mediate our classroom interactions more than we do now - but the tools do so usefully are there if packaged correctly.

jmeyer2k 3y ago
This is what we're working on building at AutoMark (https://automark.io https://automark.io). We're currently building grading tools for teachers, but eventually want to build out a tool to accurately monitor a student's performance over time. There's a lot of potential for AI to disrupt the education system from high school to college to a career. Currently, a GPA and a few test scores (SAT, ACT, etc) are the most in depth view into a student's high school performance that colleges have, but in the future, we hope to see continuous tests throughout high school that don't just show a single letter/number, but a holistic view of a student's progress, effort, etc. (Obviously the data should be controlled by the student) These could also help a student decide where to focus their study efforts.
- eganist 3y ago
  > eventually want to build out a tool to accurately monitor a student's performance over time. How does AutoMark account for disparities in quality of education?
  - jmeyer2k 3y ago
    This is a very hard problem to solve - nobody has successfully solved it before. It's not just a practical problem, because there are also a lot of political motivators. It's difficult to get districts to adopt new technologies, and teachers have a way they already like to teach. There are already some great quality resources online to learn subjects like math, history, and science, but we believe the missing piece is grading - you're never actually evaluated whether you learned something online. We think by giving students unlimited practice and feedback, along with quality learning materials, we can work on chipping away at this issue. AI will allow scaling access to quality tutoring, practice, and exams, all of which significantly improve eduction (currently, this costs $40-$X00/hr, but will cost much less with AI assistance). It's definitely not a quick fix to solve the issue of instructional quality.
  - polski-g 3y ago
    School quality has no impact in outcomes: https://web.archive.org/web/20161114182009/http://legis.wisconsin.gov/lab/reports/12-14full.pdf https://web.archive.org/web/20161114182009/http://legis.wisc...
    - blharr 3y ago
      That seems like a really bold claim that I was excited to read about in the source. But this seems like it is only saying that for one school district and one particular choice program, they weren't able to see a difference on a test.
- ecshafer 3y ago
  SAT And ACT and other standardized tests are the single best thing for giving poor students a leg up against rich students. We should be putting more emphasis on those tests. A poor but smart student can study for a test and do well on it, while they can not have continuous tutoring throughout school, paid grad students to do or proofread their homework, or extracurriculars that cost more than their parents pretax income. Your business is selling an advantage to the rich students coupled with increasing student stress throughout school. Your "holistic" view can't account for "students grades are slipping because they were sleeping in their friends basement after their parent killed another parent" or "students grades are slipping because they are working 40 hours a week, illegally, at 14", but it will holistically show "student got a B+ so their dad who makes $500k a year hired a tutor for 10 hours a week".
  - meroes 3y ago
    It’s still paying in time for a poor person. The wealthy hire an SAT tutor for a hundred+ an hour to bump their kid’s scores up by a third for maybe 20 hours of work. The poor student will spend much more time. It’s like many things where the poor pay in time rather than money.
    - slily 3y ago
      Poor people's parents don't have the money to bring them to vacations, enlist a violin teacher or drive them to baseball on the weekends, so clearly they have more time to allocate to studying and thus are advantaged. Conclusion: do away with meritocracy and just exclude poor people altogether. Did I get the "logic" right? Of course put this way it can't be valid because that wouldn't support the American Neomarxist delusion, sorry I meant worldview.
      - blharr 3y ago
        I really don't get how the context follows through on your point here. Music, sports, and travel all have been shown to increase your mental health and thinking capabilities. All I get is that if you start from an extremely unfounded point you'll get to the wrong solution. But that doesn't say anything about the points people are making here
- aaomidi 3y ago
  Please think about the ethics of what you’re about to unleash into the world.
  - germinalphrase 3y ago
    Can you be more specific? What is your ethical concern?
    - aaomidi 3y ago
      From what I’m reading, this is an unprecedented level of surveillance on students. We’re already in a mental health crisis for students. I do not think adding more surveillance is going to do good there. I may be wrong, but I hope the founders have thought a lot about this and considered what negative impacts, if any, this will have of students.
    - deleted 3y ago
      [deleted]
- UberFly 3y ago
  "accurately monitor a student's performance over time" How would it go about monitoring the students?
- BriggyDwiggs42 3y ago
  I’m so glad I’m past high school so that I won’t be labeled and tracked like a piece of grocery store meat
gxs 3y ago
This is a nice ideal to strive for, but until everyone goes through the same education system there will always be a need for some form of...standard testing across the board. I think the closest we’d be able to get to this is maybe smaller, more granular standardized test that do a better job of testing multiple specific dimensions over an academic career vs a big bang at the end. Somehow that actually sounds kind of creepy, but if that’s what you meant that’s the only way I see this done more effectively. In your experience, what other ways or ideas have you heard?
- germinalphrase 3y ago
  "I think the closest we’d be able to get to this is maybe smaller, more granular standardized test that do a better job of testing multiple specific dimensions over an academic career vs a big bang at the end." This is the heart of the concept, yes. We should be attempting to make in-classroom assessments as trustable as standardized tests which would allow them to continuously implemented during instruction. The quantity of data will provide a significantly more robust representation of a student's abilities today, and over time, compared to the infrequent snapshots of the ACT/SAT/etc.
- csa 3y ago
  > I think the closest we’d be able to get to this is maybe smaller, more granular standardized test that do a better job of testing multiple specific dimensions Don’t we pretty much have this via AP tests and SAT II Subject tests? > over an academic career vs a big bang at the end. I hate to say this, but describing the SAT as a “big bang” strikes me as funny. It’s a test of fundamental literacy and fundamental numeracy for well-educated people. It’s not that hard. The catch is that the preparation that yields high scores is developed over years. For math, it’s taking the subjects and understanding the fundamentals of these subjects. Sadly, overall math education in the US is very weak and very skewed towards males. Note that most Asians (East and South) that have to take the SAT or GRE tend to and expect to get very high scores — it’s just that easy. For the language sections, it boils down to having read and understood enough high quality “high brow” content. This high brow content covers most if not all of the vocab, reading comprehension, grammar, etc. that are needed for the test. Sadly, most young people are not exposed regularly to this type of content, and they rarely read it critically if they do have access. I’m not sure what exactly we are trying to finesse with your suggested changes.
the__alchemist 3y ago
I'd go a step further and decouple education from social status stratification as much as possible. Maybe not realistic with evolution and primate dominance hierarchies, but we can hopefully (although I'm not positive...) overcome that.
- atonse 3y ago
  How would you do that? Higher education roughly correlated with higher salaries which roughly correlates with higher status.
aaomidi 3y ago
Man I hate this. The one thing I loved about schooling in Iran is that there wasn’t a constant system of surveillance. I hate the idea of long term data collection during a time a kid is supposed to be able to learn.
- dbish 3y ago
  Yup. Take a test and show you should be a good fit for a school, awesome, have to be tracked throughout a relatively boring (classroom-wise, except for programming class) couple years of high school, no thanks.
- germinalphrase 3y ago
  Surveillance would be a less of problem if we took data and privacy rights more seriously. We should and must.
- renewiltord 3y ago
  Same. This god-damned nightmare of needing to maintain perfection is great for some kinds of people but not me. I blew off homework often, then killed it on the tests, and killed it in grad school, and quite successful in real life. But the ideal American education is a never ending series of constant evaluation - intended to measure adherence to curriculum over everything else. Absolute nightmare. I'm really considering homeschooling my kids for this.
  - aaomidi 3y ago
    I would’ve never become who I am today if I wasn’t permitted to make mistakes growing up. Western students have the highest suicide rate in the world. People are quick to blame social media, but never look at the pressure we put on them.
karaterobot 3y ago
Isn't the issue that you need a shared test to measure students from across different classrooms, let alone different cities, states, countries, etc.? I agree that it would be great if student ability could be evaluated in some other way that met the same requirements as a standardized test, but I just don't see how to do that. Apart from, I guess, a one-on-one interview for every student with the colleges they apply to. That wouldn't scale, and people would complain about bias with that, and not without reason.
- germinalphrase 3y ago
  There are distinct psychometric techniques used to validate the trustability of assessments. Those same techniques could be used to validate the classroom assessments, but - obviously - no one has the financial or time budget to implement such a thing. So, the idea is that you would begin by providing an assessment creation tool that can be seamlessly implemented in the classroom that also has the ability, in a more aggregated fashion, to develop assessments that pass psychometric evaluation. Would it replace the ACT/SAT immediately? Of course not. The effort would be a classic innovator's dilemma scenario in which the continuous collection of curriculum, instruction and assessment content creates a unique (and, currently, silo'ed/analog) data set against which to continuously improve the quality of the assessment tool. From there - you branch out into instructional support more broadly, but that's a much broader and more difficult context.
dbish 3y ago
How would you compare raw intelligence or cross schools? That kind of calibration and opportunity for smart students who had other reasons to not focus or care about high school and other remedial grades is really important.
- germinalphrase 3y ago
  Assessment can serve many goals, but yes - ranking and benchmarking are an important function. See my comment elsewhere for the general concept.
- maximus-decimus 3y ago
  If the goal is just to test intelligence, why are we even pretending doing something else and not just giving IQ tests.
  - dbish 3y ago
    SATs and ACTs are pretty close to IQ tests
huytersd 3y ago
Classrooms are not built equal. The grading is highly subjective based on the teacher and there is a strong incentive to make it seem like kids are doing better than they really are. Nothing can replace a standardized test that puts everyone on an objectively measurable plane.
- germinalphrase 3y ago
  If there were a common tool for integrating assessment into instruction, it would be possible to continue to rank/sort students regardless of their educational context. Understanding the rigor of the course itself would necessarily be quantifiable as well. Think of it more like "we do a standardized test every lesson/week/month" instead of once a year.
  - huytersd 3y ago
    A lot of Asian schools have that. State tier board exams that are standardized for every year of high school.
lvl102 3y ago
In an ideal world, we wouldn’t have a tiered education system and that everyone will have access to master any subject/curriculum regardless of age. Therefore, we wouldn’t need an arbitrary and flawed aptitude tests.
- deleted 3y ago
  [deleted]
- germinalphrase 3y ago
  No disagreement here.
- BlueFalconHD 3y ago
  I agree. If a child understands and excels at some topic, they should have the choice to move on to the next? (I believe this is what you mean, correct me if I'm wrong)
- csa 3y ago
  > In an ideal world, we wouldn’t have a tiered education system and that everyone will have access to master any subject/curriculum regardless of age. I’m not sure where you are, but I’m in the US (specifically California). This dream of yours pretty much exists. > Therefore, we wouldn’t need an arbitrary and flawed aptitude tests. The aptitude tests are more for matching folks who will be more closely matched in terms of quantity and speed of learning. There is definitely some virtue signaling as well via elite admissions, but that doesn’t exclude anyone from learning pretty much most subjects. Maybe I don’t understand what you’re suggesting.
huytersd 3y ago
Eh I fucked around in high school a bunch (prob showed up to 40% of it) but still aced all my tests. I like the standard test gateway paradigm. Without it I wouldn’t have achieved the success I have today.
Manuel_D 3y ago
How do you do that data collection, though? And more importantly, how do you effectively compare across different schools and districts? Some high school give out As in math to students that can't do basic algebra.
- germinalphrase 3y ago
  Analyzing curriculum contents and local instruction transcription. Ranking and benchmarking between educational environments would require an additional psychometric evaluation layer. This would not a Day One function, so the tool would focus on maximizing utility as an assessment assistant tool for instructors. There is a bridge to be built between formative and summative assessment. If this thing doesn't make them better instructors, it would be dead in the water anyway.
  - Manuel_D 3y ago
    At that point you're just describing another form of standardized testing. The whole point of a test like the SAT is to administer the same test so that results are comparable.
    - germinalphrase 3y ago
      The function without the apparatus. Everyday, all across the country - we pay teachers to teach and assess their students. Those assessment results aren’t trustable for benchmarking and ranking students, so we have standardized testing. Obviously, yes - one intention of this concept is that it serves the same function as standardized testing, but it does so while eliding the externalities of cost and single, high stakes exams by allowing classroom assessment - made and proctored by the instructors during their standard lessons - to become trustable.
AtlasBarfed 3y ago
With what, a standardized curriculum? That is a hell of a can of worms as you probably know. Apply an AI agent to the sum total of student output? Can't wait for the entrenched racial bias to leak into the AI and a host of other issues. If you could get an AI implemented that didn't involve reporting to the greater regulatory bodies, I can see that working, but that's the issue with things like that: management wants to see them and then the stats rapidly get watered down to meaninglessness. It would be crazy to see if an AI can start diagnosing home issues, abuse, etc from student output and performance. I can see a lot of benefits, as long as the AI output is private.
- germinalphrase 3y ago
  No standardized curriculum. Utilize the instructor’s curriculum and a local, live transcription of the instructor to continuously create assessment content that can be rapidly curated and proctored within the flow of the lesson. The vision is not as grand as your last paragraph.
debacle 3y ago
Enders Game had this technology and it was so much worse than an SAT.
- germinalphrase 3y ago
  I don’t seem to share a lot of values with Orson Scott Card.

jmeyer2k 3y ago

This is what we're working on building at AutoMark (https://automark.io https://automark.io). We're currently building grading tools for teachers, but eventually want to build out a tool to accurately monitor a student's performance over time. There's a lot of potential for AI to disrupt the education system from high school to college to a career. Currently, a GPA and a few test scores (SAT, ACT, etc) are the most in depth view into a student's high school performance that colleges have, but in the future, we hope to see continuous tests throughout high school that don't just show a single letter/number, but a holistic view of a student's progress, effort, etc. (Obviously the data should be controlled by the student) These could also help a student decide where to focus their study efforts.

eganist 3y ago
> eventually want to build out a tool to accurately monitor a student's performance over time. How does AutoMark account for disparities in quality of education?
- jmeyer2k 3y ago
  This is a very hard problem to solve - nobody has successfully solved it before. It's not just a practical problem, because there are also a lot of political motivators. It's difficult to get districts to adopt new technologies, and teachers have a way they already like to teach. There are already some great quality resources online to learn subjects like math, history, and science, but we believe the missing piece is grading - you're never actually evaluated whether you learned something online. We think by giving students unlimited practice and feedback, along with quality learning materials, we can work on chipping away at this issue. AI will allow scaling access to quality tutoring, practice, and exams, all of which significantly improve eduction (currently, this costs $40-$X00/hr, but will cost much less with AI assistance). It's definitely not a quick fix to solve the issue of instructional quality.
- polski-g 3y ago
  School quality has no impact in outcomes: https://web.archive.org/web/20161114182009/http://legis.wisconsin.gov/lab/reports/12-14full.pdf https://web.archive.org/web/20161114182009/http://legis.wisc...
  - blharr 3y ago
    That seems like a really bold claim that I was excited to read about in the source. But this seems like it is only saying that for one school district and one particular choice program, they weren't able to see a difference on a test.
ecshafer 3y ago
SAT And ACT and other standardized tests are the single best thing for giving poor students a leg up against rich students. We should be putting more emphasis on those tests. A poor but smart student can study for a test and do well on it, while they can not have continuous tutoring throughout school, paid grad students to do or proofread their homework, or extracurriculars that cost more than their parents pretax income. Your business is selling an advantage to the rich students coupled with increasing student stress throughout school. Your "holistic" view can't account for "students grades are slipping because they were sleeping in their friends basement after their parent killed another parent" or "students grades are slipping because they are working 40 hours a week, illegally, at 14", but it will holistically show "student got a B+ so their dad who makes $500k a year hired a tutor for 10 hours a week".
- meroes 3y ago
  It’s still paying in time for a poor person. The wealthy hire an SAT tutor for a hundred+ an hour to bump their kid’s scores up by a third for maybe 20 hours of work. The poor student will spend much more time. It’s like many things where the poor pay in time rather than money.
  - slily 3y ago
    Poor people's parents don't have the money to bring them to vacations, enlist a violin teacher or drive them to baseball on the weekends, so clearly they have more time to allocate to studying and thus are advantaged. Conclusion: do away with meritocracy and just exclude poor people altogether. Did I get the "logic" right? Of course put this way it can't be valid because that wouldn't support the American Neomarxist delusion, sorry I meant worldview.
    - blharr 3y ago
      I really don't get how the context follows through on your point here. Music, sports, and travel all have been shown to increase your mental health and thinking capabilities. All I get is that if you start from an extremely unfounded point you'll get to the wrong solution. But that doesn't say anything about the points people are making here
aaomidi 3y ago
Please think about the ethics of what you’re about to unleash into the world.
- germinalphrase 3y ago
  Can you be more specific? What is your ethical concern?
  - aaomidi 3y ago
    From what I’m reading, this is an unprecedented level of surveillance on students. We’re already in a mental health crisis for students. I do not think adding more surveillance is going to do good there. I may be wrong, but I hope the founders have thought a lot about this and considered what negative impacts, if any, this will have of students.
  - deleted 3y ago
    [deleted]
UberFly 3y ago
"accurately monitor a student's performance over time" How would it go about monitoring the students?
BriggyDwiggs42 3y ago
I’m so glad I’m past high school so that I won’t be labeled and tracked like a piece of grocery store meat

gxs 3y ago

This is a nice ideal to strive for, but until everyone goes through the same education system there will always be a need for some form of...standard testing across the board. I think the closest we’d be able to get to this is maybe smaller, more granular standardized test that do a better job of testing multiple specific dimensions over an academic career vs a big bang at the end. Somehow that actually sounds kind of creepy, but if that’s what you meant that’s the only way I see this done more effectively. In your experience, what other ways or ideas have you heard?

germinalphrase 3y ago
"I think the closest we’d be able to get to this is maybe smaller, more granular standardized test that do a better job of testing multiple specific dimensions over an academic career vs a big bang at the end." This is the heart of the concept, yes. We should be attempting to make in-classroom assessments as trustable as standardized tests which would allow them to continuously implemented during instruction. The quantity of data will provide a significantly more robust representation of a student's abilities today, and over time, compared to the infrequent snapshots of the ACT/SAT/etc.
csa 3y ago
> I think the closest we’d be able to get to this is maybe smaller, more granular standardized test that do a better job of testing multiple specific dimensions Don’t we pretty much have this via AP tests and SAT II Subject tests? > over an academic career vs a big bang at the end. I hate to say this, but describing the SAT as a “big bang” strikes me as funny. It’s a test of fundamental literacy and fundamental numeracy for well-educated people. It’s not that hard. The catch is that the preparation that yields high scores is developed over years. For math, it’s taking the subjects and understanding the fundamentals of these subjects. Sadly, overall math education in the US is very weak and very skewed towards males. Note that most Asians (East and South) that have to take the SAT or GRE tend to and expect to get very high scores — it’s just that easy. For the language sections, it boils down to having read and understood enough high quality “high brow” content. This high brow content covers most if not all of the vocab, reading comprehension, grammar, etc. that are needed for the test. Sadly, most young people are not exposed regularly to this type of content, and they rarely read it critically if they do have access. I’m not sure what exactly we are trying to finesse with your suggested changes.

the__alchemist 3y ago

I'd go a step further and decouple education from social status stratification as much as possible. Maybe not realistic with evolution and primate dominance hierarchies, but we can hopefully (although I'm not positive...) overcome that.

atonse 3y ago
How would you do that? Higher education roughly correlated with higher salaries which roughly correlates with higher status.

aaomidi 3y ago

Man I hate this. The one thing I loved about schooling in Iran is that there wasn’t a constant system of surveillance. I hate the idea of long term data collection during a time a kid is supposed to be able to learn.

dbish 3y ago
Yup. Take a test and show you should be a good fit for a school, awesome, have to be tracked throughout a relatively boring (classroom-wise, except for programming class) couple years of high school, no thanks.
germinalphrase 3y ago
Surveillance would be a less of problem if we took data and privacy rights more seriously. We should and must.
renewiltord 3y ago
Same. This god-damned nightmare of needing to maintain perfection is great for some kinds of people but not me. I blew off homework often, then killed it on the tests, and killed it in grad school, and quite successful in real life. But the ideal American education is a never ending series of constant evaluation - intended to measure adherence to curriculum over everything else. Absolute nightmare. I'm really considering homeschooling my kids for this.
- aaomidi 3y ago
  I would’ve never become who I am today if I wasn’t permitted to make mistakes growing up. Western students have the highest suicide rate in the world. People are quick to blame social media, but never look at the pressure we put on them.

karaterobot 3y ago

Isn't the issue that you need a shared test to measure students from across different classrooms, let alone different cities, states, countries, etc.? I agree that it would be great if student ability could be evaluated in some other way that met the same requirements as a standardized test, but I just don't see how to do that. Apart from, I guess, a one-on-one interview for every student with the colleges they apply to. That wouldn't scale, and people would complain about bias with that, and not without reason.

germinalphrase 3y ago
There are distinct psychometric techniques used to validate the trustability of assessments. Those same techniques could be used to validate the classroom assessments, but - obviously - no one has the financial or time budget to implement such a thing. So, the idea is that you would begin by providing an assessment creation tool that can be seamlessly implemented in the classroom that also has the ability, in a more aggregated fashion, to develop assessments that pass psychometric evaluation. Would it replace the ACT/SAT immediately? Of course not. The effort would be a classic innovator's dilemma scenario in which the continuous collection of curriculum, instruction and assessment content creates a unique (and, currently, silo'ed/analog) data set against which to continuously improve the quality of the assessment tool. From there - you branch out into instructional support more broadly, but that's a much broader and more difficult context.

dbish 3y ago

How would you compare raw intelligence or cross schools? That kind of calibration and opportunity for smart students who had other reasons to not focus or care about high school and other remedial grades is really important.

germinalphrase 3y ago
Assessment can serve many goals, but yes - ranking and benchmarking are an important function. See my comment elsewhere for the general concept.
maximus-decimus 3y ago
If the goal is just to test intelligence, why are we even pretending doing something else and not just giving IQ tests.
- dbish 3y ago
  SATs and ACTs are pretty close to IQ tests

huytersd 3y ago

Classrooms are not built equal. The grading is highly subjective based on the teacher and there is a strong incentive to make it seem like kids are doing better than they really are. Nothing can replace a standardized test that puts everyone on an objectively measurable plane.

germinalphrase 3y ago
If there were a common tool for integrating assessment into instruction, it would be possible to continue to rank/sort students regardless of their educational context. Understanding the rigor of the course itself would necessarily be quantifiable as well. Think of it more like "we do a standardized test every lesson/week/month" instead of once a year.
- huytersd 3y ago
  A lot of Asian schools have that. State tier board exams that are standardized for every year of high school.

lvl102 3y ago

In an ideal world, we wouldn’t have a tiered education system and that everyone will have access to master any subject/curriculum regardless of age. Therefore, we wouldn’t need an arbitrary and flawed aptitude tests.

deleted 3y ago
[deleted]
germinalphrase 3y ago
No disagreement here.
BlueFalconHD 3y ago
I agree. If a child understands and excels at some topic, they should have the choice to move on to the next? (I believe this is what you mean, correct me if I'm wrong)
csa 3y ago
> In an ideal world, we wouldn’t have a tiered education system and that everyone will have access to master any subject/curriculum regardless of age. I’m not sure where you are, but I’m in the US (specifically California). This dream of yours pretty much exists. > Therefore, we wouldn’t need an arbitrary and flawed aptitude tests. The aptitude tests are more for matching folks who will be more closely matched in terms of quantity and speed of learning. There is definitely some virtue signaling as well via elite admissions, but that doesn’t exclude anyone from learning pretty much most subjects. Maybe I don’t understand what you’re suggesting.

huytersd 3y ago

Eh I fucked around in high school a bunch (prob showed up to 40% of it) but still aced all my tests. I like the standard test gateway paradigm. Without it I wouldn’t have achieved the success I have today.

Manuel_D 3y ago

How do you do that data collection, though? And more importantly, how do you effectively compare across different schools and districts? Some high school give out As in math to students that can't do basic algebra.

germinalphrase 3y ago
Analyzing curriculum contents and local instruction transcription. Ranking and benchmarking between educational environments would require an additional psychometric evaluation layer. This would not a Day One function, so the tool would focus on maximizing utility as an assessment assistant tool for instructors. There is a bridge to be built between formative and summative assessment. If this thing doesn't make them better instructors, it would be dead in the water anyway.
- Manuel_D 3y ago
  At that point you're just describing another form of standardized testing. The whole point of a test like the SAT is to administer the same test so that results are comparable.
  - germinalphrase 3y ago
    The function without the apparatus. Everyday, all across the country - we pay teachers to teach and assess their students. Those assessment results aren’t trustable for benchmarking and ranking students, so we have standardized testing. Obviously, yes - one intention of this concept is that it serves the same function as standardized testing, but it does so while eliding the externalities of cost and single, high stakes exams by allowing classroom assessment - made and proctored by the instructors during their standard lessons - to become trustable.

AtlasBarfed 3y ago

With what, a standardized curriculum? That is a hell of a can of worms as you probably know. Apply an AI agent to the sum total of student output? Can't wait for the entrenched racial bias to leak into the AI and a host of other issues. If you could get an AI implemented that didn't involve reporting to the greater regulatory bodies, I can see that working, but that's the issue with things like that: management wants to see them and then the stats rapidly get watered down to meaninglessness. It would be crazy to see if an AI can start diagnosing home issues, abuse, etc from student output and performance. I can see a lot of benefits, as long as the AI output is private.

germinalphrase 3y ago
No standardized curriculum. Utilize the instructor’s curriculum and a local, live transcription of the instructor to continuously create assessment content that can be rapidly curated and proctored within the flow of the lesson. The vision is not as grand as your last paragraph.

debacle 3y ago

Enders Game had this technology and it was so much worse than an SAT.

germinalphrase 3y ago
I don’t seem to share a lot of values with Orson Scott Card.