4 ms·
it would be cool if it was judged by humans, blinded to whether the submissions were 0% ai, some ai, 100% ai, etc. but it is judged by ai, which makes it much
by john_strinlai 4mo ago
it would be cool if it was judged by humans, blinded to whether the submissions were 0% ai, some ai, 100% ai, etc.
but it is judged by ai, which makes it much less cool in my opinion.
to demonstrate the absurdity, the second best submission right now has a note "Literally the Fable essay, but with one letter changed", ranking 10 pts higher than the Fable one.
- fkozlowski 4mo agoIt is actually judged by a human at the end FYI. "The top 5 submissions will be finalists, judged by hand."
- UncleOxidant 4mo agoKind of like submitting resumes these days. AI winnows them down and the remaining few get passed to humans.
- sph 4mo agoAnd who knows what ‘gems’ might have been skipped by the machine.
- john_strinlai 4mo agoit still loses its luster, for me, knowing that the top 5 are ai-selected
- deleted 4mo ago[deleted]
- UncleOxidant 4mo agoI'm trying to figure out why I should have any interest at all in participating in this? I mean, other than the $1000, but there's really no clear criteria as to what would win that $1000 since AI is judging it.
- 383toast 4mo agoI mean it's obvious that note is trolling
- john_strinlai 4mo agounless you have seen the submission, i have no idea how you could possibly know. so, if you don't mind, what are the 'tells'? what "obvious" things did i miss?
- 383toast 4mo agoI worked a lot with designing and implementing agentic grading at my job, there's a ~0 chance that on a rubric with 180 items, changing 1 char out of 6000 words would result in a flip in 10+ grading items :)