3 ms·
Can anyone shed light on how it works? There is another one that comes to mind, PTE exam. The PTE exam is fully computer graded (as far as I know), including w
by akudha 6y ago
Can anyone shed light on how it works? There is another one that comes to mind, PTE exam.
The PTE exam is fully computer graded (as far as I know), including written essay. I wonder how they do it. The algorithm has to account for topic relevance, grammatical errors, style, clarity etc etc. Topic relevance alone can be quite hard, isn't it? If the question is "What is your opinion on making voting mandatory? Support with examples", I can talk about voting and elections without actually giving an opinion. How does the algo detect it?
PTE, Hemingway app etc - really intriguing to reduce human language to logic and calculation.
- iudqnolq 6y agoYou might enjoy this researcher's automated high scoring essay generator > Our hypothesis was simple. If the AES machine consistently gave high scores to machine generated gibberish, we could surmise that 1) the construct being measured by the machines is not an essential component of human communication; and 2) students could be taught similar strategies to achieve high scores on computer scored writing tests by sprinkling their prose with long meaningless sentences composed of pretentious and irrelevant words. > Our greatest surprise was how easy it was to fool all of the machines. We succeeded on our first try, demonstrating that rather than being elegant and complex manifestations of state-of-the-art artificial intelligence, these engines could best be characterized as crude stupid machines. EDIT (an example): > We have now used the Babel Generator over twenty times to generate essays for the site, which, when submitted, receive top scores with comments such as articulates a clear and insightful position on the issue in accordance with the assigned task and sustains a well-focused, well-organized analysis, connecting ideas logically” for essays that read like this following opening paragraph: > Careers with corroboration has not, and in all likelihood never will be compassionate, gratuitous, and disciplinary. Mankind will always proclaim noesis; many for a trope but a few on executioner. A quantity of vocation lies in the study of reality as well as the area of semantics. Why is imaginativeness so pulverous to happenstance? The reply to this query is that knowledge is vehemently and boisterously contemporary. https://lesperelman.com/writing-assessment-robo-grading/babel-generator/ https://lesperelman.com/writing-assessment-robo-grading/babe...