10 ms·
> Utah has been using AI as the primary scorer on its standardized tests for several years. “It was a major cost to our state to hand score, in addition to very
by dahart 7y ago
> Utah has been using AI as the primary scorer on its standardized tests for several years. “It was a major cost to our state to hand score, in addition to very time consuming,” said Cydnee Carter, the state’s assessment development coordinator. The automated process also allowed the state to give immediate feedback to students and teachers, she said.
Yes, education takes time and costs money. Yes, not educating is both cheaper and faster. Note how the rationalizing ignores the needs of the students and the quality of the education.
I live in Utah and my children have been subjected to this automated essay scoring here. One night I came home from work and my son and wife were both in tears, frustrated with each other and frustrated with the essay scoring which refused to give a high enough score to meet what the teacher said was required, no matter how good the essay was. My wife wrote versions herself from scratch and couldn’t get the required score. When I got involved, I did the same with the same results.
Turns out the instructions said the essay would be scored on verbal efficiency; getting the point across clearly with the fewest words. I started playing around and realized that the more words I added, the higher the score, whether they were relevant or grammatical or not. Random unrelated sentences pasted in the middle would increase the score. We found a letter of petition online for banning automated scoring for the purposes of grades or student evaluation of any kind. It was very long, so it got a perfect score. I encouraged my son to submit it, and he did. Later I visited his teacher to explain and to urge her to not use automated scoring. She listened and then told me about how much time it saves and how fast students get feedback. :/
- daveFNbuck 7y agoDo you just get to keep submitting the essay to see what score it will get before you turn it in? That sounds like a bigger problem than any of the particulars about how the grading is done.
- dahart 7y agoIn this case, there was a limit to the number of times the essay could be submitted, and there was a required score that needed to be obtained within that limit, otherwise the grade would go down. The limit was something like 20 tries, and when I got there they’d already used maybe 14 of them. I could perhaps see value in having unlimited tries, as a teaching aid, if the result wasn’t being used for grading. That would at least leave room for curiosity and exploration. And, more importantly, I could see value if the software wasn’t essentially a scam that fundamentally is not able do what is advertised. If the software really could grade essays reliably, and provide meaningful suggestions for improvement, then maybe it could be used to help educate students, in conjunction with the teacher’s guidance. But the software does not grade reliably, and it absolutely does not offer meaningful constructive feedback, and the teachers were using it to avoid reading essays, not to supplement their own expertise. One of the several amusing ironies here is how the software company has convinced the state and teachers to willingly replace themselves with bots, despite obvious evidence that the humans can do the job better.
- daveFNbuck 7y agoI can see how giving students multiple tries would be a great teaching aid if we had human-level AI. With what we have now, I'd bet it's just training them to produce essays that hit the flaws in the AI as hard as possible to produce unreadable garbage with high scores. 20 tries per essay adds up to a lot across 12 years of schooling. Teachers are extremely overworked, underpaid, and underappreciated. I'm not surprised that it was easy to convince them to offload the difficult and time-consuming work of manually grading essays. This also means they don't have to deal with complaints about unfair grading. A machine did it and it's out of their hands.
- nyxtom 7y agoThis needs to just be outright banned
- c3534l 7y agoIt's be easier and equally fair to just grade student's essays by rolling a pair of dice.
- ejk314 7y agoIt's arguably more fair. At least purely random scoring doesn't incentivize cheating.
- clay_the_ripper 7y agoWow this is pretty shocking. I can understand using automated systems for something like math problems, it makes sense. There’s (usually) one right answer. But essays? This should be banned.
- Baeocystin 7y agoWait 'til you see a kid in tears because the math answer they submitted was supposed to equal zero, but the algorithms behind the scenes are so bad that the float math failed the equality check. Note: This is not hyperbole, I have seen this exact scenario more than once. There may be a place for a well-designed one, but if it exists, I've never seen it.
- dvdbloc 7y agoI know this is just my experience but I can confirm the automated math scoring system I was using in a large US university in 2012 had bugs where many times I would enter a complex solution with fractions and it would tell me I was wrong and the correct response was some other form of the same equivalent fraction... Talk about frustrating after pouring over a question for 10 minutes.
- DoctorOetker 7y agowhat was the allowed form of the fraction? a ratio of literal integers, or also including irrationals? variables? did the scoring system need to know formulas? as in (2/3)v =?= (2/3) omega*r ? if only the last one is not required of the scoring system, then it's been available for ages, and its just a really poor implementation. That's not programming but plumbing data-pipes.
- black6 7y agoI remember to this day when I went round and round with a calculus teacher in high school who told me "sin(x) + 2" was incorrect. Then answer she wanted was "2 + sin(x)". I argued that addition was commutative, "2 + 3 = 3 + 2" and so forth. She wouldn't budge. She also said it was impossible to calculate the exact area under a curve, because you can't draw an infinite number of boxes under the curve. Having an ignorant teacher is almost as bad as a flawed, black-box algorithm.
- analyst74 7y agoThink from a positive angle, students today are learning useful life skills to game computer systems, which they will have to deal with when they grow up. edit: ...just like how previous generations have to learn how to game social systems.
- alexanderdmitri 7y agoExcept the algorithm being gamed can change suddenly, drastically and without the gamer's knowledge. When such changes occur, the gamer will be docked until they can reverse-engineer the new algorithm. There's also the risk that all their previous inputs "gaming" the system might be reconsumed to terrible results as well, effectively rewriting their historical performance disasterously. As always, those with the social standing and power to have insider knowledge or guidance will be in the best position to profit off such systems.
- ALittleLight 7y agoWhen I was a child I was obsessed with the "grade level" function in Microsoft Word. It was a preference you could enable on spell check to tell you the "grade level" of your writing. Every essay I wrote, I'd always force myself to reach the max "12.0" grade level. While writing I'd struggle over word choice, sentence structure, rearranging paragraphs, working on my tone etc, all in pursuit of the 12th grade way to phrase things. All my revisions were subject to the approval of the Grade Level checker. Whenever I could I would check the grade levels of my friend's writing - usually by showing them a "neat feature" they could enable. Then, I'd smugly applaud myself for being the better writer whenever their grade level was below 12.0. The Grade Level feature fascinated me and to try and master it, I found a book about Microsoft Word and looked through it in a bookstore. I was absolutely gobsmacked at how simple the formulas was. I had childishly been expecting something, like perhaps Utah educators imagine they have. I genuinely expected the method to be complex beyond my understanding. Instead, Word used a variant of Flesch-Kincaid. There was a direct relationship between sentence length and grade score, and polysyllabic words and grade score. Meaning, the longer your sentences and words, the higher your grade score. As soon as I got home from the bookstore I loaded a draft of something I had written. It was "pre-12.0" writing from me. I simply deleted all the periods but one and checked again. 12.0. Automatic grading is a wonderful lure. It's nice to imagine that there's some objective writing quality easy to tap into. At the moment, I think we're far from that ability. Personally, I feel the solution to insufficient teacher time is to use peer grading much more, and spot checks. Get kids to read and revise each other's works frequently, and teachers should aim to grade at least N papers per student where N is much less than the number of papers a student writes. Revising is a really vital part of writing. Getting more chances to do revision, plus having to write something good enough to show your peers, plus having the risk of any paper count for your grade should compensate for incomplete teacher grading.
- nraynaud 7y agowait, you get the score in real time? Like some kind of objective function you can train a machine to maximise on?
- christophilus 7y agoHeh heh. I like the way you think. Hackers of Utah unite!
- piokoch 7y agoFrankly, I can't believe what I am reading. The idea that some "AI" grades essays automatically is idiotic and has nothing to do with education. Where is the place for discussions? Where is the place for ideas confrontation? Where is the place for writing style development? How this AI is supposed to grade things like repetitions (that can be either good rhetorical tool or a mistake, depending on context), etc? Who the hell came out with such an idea. I would even hesitate to use "AI" for automatic spell checking as it is sufficient to give some character unusual name and it will be marked as error. My guess is that soon or later people will learn how to game that AI. I wouldn't be surprised if there were some software that will generate essay that Utah "AI" likes.
- dagw 7y agoMy guess is that soon or later people will learn how to game that AI. Already been done. http://lesperelman.com/writing-assessment-robo-grading/babel-generator/ http://lesperelman.com/writing-assessment-robo-grading/babel... Here's a sample essay that is complete nonsense and got a perfect score on the GRE. http://lesperelman.com/wp-content/uploads/2015/12/6-6_ScoreItNow_2015_Feb20.pdf http://lesperelman.com/wp-content/uploads/2015/12/6-6_ScoreI...
- thombat 7y agoThe final paragraph from that example is steaming gibberish that nobody could mistake for English: "Calling has not, and undoubtedly never will be aggravating in the way we encounter mortification but delineate the reprimand that should be inclination. Nonetheless, armed with the knowledge that the analysis augurs stealth with propagandists, almost all of the utterances on my authorization journey. Since sanctions are performed at knowledge, a quantity of vocation can be more gaudily inspected. Knowledge will always be a part of society.Vocation is the most presumptuously perilous assassination of mankind." Yet the robo-scoring acclaims it as: * articulates a clear and insightful position on the issue in accordance with the assigned task * develops the position fully with compelling reasons and/or persuasive examples * sustains a well-focused, well-organized analysis, connecting ideas logically * conveys ideas fluently and precisely, using effective vocabulary and sentence variety * demonstrates superior facility with the conventions of standard written English (i.e., grammar, usage, and mechanics) but may have minor errors Any teacher faced with the requirement to use such tools would be better placed instructing their class on civil disobedience.
- yoz-y 7y ago> Turns out the instructions said the essay would be scored on verbal efficiency; getting the point across clearly with the fewest words. I started playing around and realized that the more words I added, the higher the score, whether they were relevant or grammatical or not. Frankly, this does not change anything from my experience in school decades ago. The teachers always said that the length does not matter and we should not pad the papers. However students who wrote more pages got better scores every single time.
- MertsA 7y agoHistorically on the written portion of the SAT length is substantially correlated to the final score.
- chessturk 7y agoI'm not sure that's an issue by itself. If the prompt is broad enough, a minimum length can be reasonable for essays. It certainly could be a problem if the prompt was too narrow, or time constraints, or some other factor. Do you think the correlation by itself indicates something negative/inefficient I'm missing?
- yoz-y 7y agoI think that the required length should be bounded on both sizes and penalised if the paper is either too short or too long.
- bradstewart 7y agoIs it possible that the students who wrote shorter papers were in fact presenting incomplete arguments and/or thoughts? Writing clearly and concisely is extremely difficult.
- yoz-y 7y agoIt is possible but all of them? Also by “short” I usually mean four pages which was the usual recommendation for a paper length. To have a good grade one would need to write ten. The subject was usually something vapid so most of that must have been drivel.
- _0ffh 7y ago>Turns out the instructions said the essay would be scored on verbal efficiency; getting the point across clearly with the fewest words. I started playing around and realized that the more words I added, the higher the score Apart from the fact that your story is straight up frightening, isn't this part completely backwards, too? I mean, clearly using more words to convey the same message is /less/ efficient, not more so?
- dahart 7y agoYes. Exactly. Before I figured out how to game the program, my son and wife were editing shorter. That’s what the instructions said to do. And, that’s also a major strategy for decent writing: brainstorm a lot, then edit down to the good parts. What this means is the software’s scoring is an anti-incentive to good writing. Used as a teaching aid, it’s actually doing pure damage, not good. Not only can it not score reliably, nor provide meaningful feedback, it’s actually actively teaching a very wrong way to write. But it is cheaper than humans, and it does give immediate feedback, so there’s that.
- YeGoblynQueenne 7y agoHo ho. Wait. You mean you were able to submit multiple versions of the essay? So that anyone can basically game the test, by submitting multiple essays until they get the best score they can wring out of it? That is just mad.
- raxxorrax 7y agoYou have automated systems that rate essays without any human actually reading them? Kids, forget everything you know because crime does indeed pay off. Best grades will be reserved for those that try to cheat this system however it is implemented. Botting your essays is the way to go in the 21st century.
- dagw 7y agoGiven that the stack ranking at your future job will also be done by an "AI" (probably developed by the same company that graded you tests) this is a very useful skill to have.
- bryanrasmussen 7y agoGood point, I better teach my kid this skill so she can go on to a job programming one of these "AIs" idiocracy will happen not because people get any stupider, but because the bots reward the stupid ones first.
- xamuel 7y agoMaybe Idiocracy was right about the whole "It's got electrolytes!" meme, except swap out electrolytes for neural networks.
- bryanrasmussen 7y agoNow I need a video of Luke Wilson saying "What are neural networks? Do you even know?"
- bryanrasmussen 7y agoI went to high school in Utah, long before this automated scoring. It sounds awful but considering the quality of the education I received there perhaps not that bad after all. My best Utah education anecdote - In the first day of British literature class the teacher came in and asked "Does anyone here know what A.D means?" someone said After Death - she said no. I figured this was my time to shine so I raised my eager hand and said "Anno Domini, in the year of the lord" - she said no. Then she announced: "A.D means after the Deluge, and B.C means before Christ". She also totally lied to me one time about whether she would be considering a particular textbook question as applying to Rosencrantz or Guildenstern. Anyway I think that was one of the many classes I got an F in after stopped going and would walk past it every day on my way to play chess with my German teacher.
- C1sc0cat 7y agoHow is this relevant in a Lit class - presumably you hid the fact you where a Catholic / Anglican from her.
- bryanrasmussen 7y agoI don't know the relevance, I guess she just felt enthused about sharing some of her learning with us impressionable minds.
- bryanrasmussen 7y agoActually I am and was an atheist, but I had recently been on an "I'm going to read the encyclopedia!" mission.
- bigred100 7y agoThis is a problem I have with a lot of human behavior. Instead of admitting you don’t have the resources to do something or aren’t willing to prioritize it, people come up with a bad version that’s not worth doing. Lots of things are worth doing poorly, but many of them I believe you just need to admit are not worth it unless a certain level of performance is met. What’s even cheaper than AI? Tell the students to write some pages, have the teacher glance at the number of pages written, give full credit if the mark was met, and throw the papers out without reading them. It sounds like it would be similarly effective and less aggravating. Unfortunately, this would require humility on the part of the educators.
- imtringued 7y agoI can't even comprehend how someone can use automation for a task like this... It completely goes against human nature. In a world where all jobs have been automated teachers would be the last ones to go before humanity is completely obsolete.
- seanmcdirmid 7y agoThat really sounds like Utah, they have lots of students (due to LDS influences) with a conservative government (ditto), so the pupil/teacher ratio is insane. I can guess the teacher really doesn’t have any other choice.
- pault 7y agoThe instant feedback mechanism is just begging for someone to turn it into a GAN by writing the other half. I would absolutely love to hear that some particularly clever high school student was able to train an ML algorithm to consistently fool the grading algorithm, thus instantly rendering all of their efforts worthless and dragging the administrators through the mud at the same time.