arjun810

6 ms·

1.
Preventing agents from cheating on our custom SWE-Bench(superconductor.com)
5 points by arjun810 2mo ago|0 comments
2.
by arjun810 6mo ago
it’s not a paid list. Or at least it wasn’t, can’t say with certainty it didn’t change.
3.
by arjun810 8mo ago
Our results on our rails app surprised us. Codex 5.3 far and away the best — much faster and cheaper (though cost isn’t relevant yet, since you can only access this model via a ChatGPT plan). https://x.com/sergeykarayev&#x2F
4.
by arjun810 1y ago
We had exactly the same desire and built it as well, with a nice mobile UI and live app previews. Would love to get your feedback — let me know how to contact you if you’re curious.
5.
by arjun810 3y ago
We’ve also been happily using Depot.
6.
Traptic: Strawberry Picking Robots(traptic.com)
2 points by arjun810 7y ago|0 comments
7.
by arjun810 9y ago
This is exactly what we think is a fairly common attitude -- thanks for stating it so clearly! It has ramifications both within a single class and when you think about how prerequisite and dependent classes are structured.
8.
by arjun810 9y ago
I do agree that applying psychometrics would be great, but it's not as simple as it sounds -- the vast majority of work is on multiple choice questions, or binary correct/incorrect. There is some on free response, but much less. W
9.
by arjun810 9y ago
Totally agree that this is not a fully rigorous analysis, and we do want to dig deeper and try to extend some IRT models to these types of questions. The main point of this post is to highlight that the most common metric of student perform
10.
by arjun810 10y ago
39% of core operations are funded by the state. https://en.m.wikipedia.org/wiki/University_of_California_fin...
11.
by arjun810 10y ago
The trend is towards neither, I'd say. The biggest trend has been towards online automatically graded multiple choice & short answer questions that aren't really open ended. The automated essay grading stuff typically looks at
12.
by arjun810 10y ago
I'm one of the founders of Gradescope (the company in the other post). I see where you're coming from, but I actually think that both of these posts describe ways for students to get more open ended assessment, rather than automat
13.
by arjun810 10y ago
Gradescope - https://gradescope.com | Berkeley, CA | full time | ONSITE Assessment in education is broken -- instructors spend hours grading, and yet don't get a clear picture of what their students are struggling with. Gra
14.
by arjun810 10y ago
Gradescope - https://gradescope.com | Berkeley, CA | full time | ONSITE Assessment in education is broken -- instructors spend hours grading, and yet don't get a clear picture of what their students are struggling with. Gra
15.
by arjun810 11y ago
Gradescope - https://gradescope.com Berkeley, CA | ONSITE Assessment in education is broken -- instructors spend hours grading, and yet don't get a clear picture of what their students are struggling with. Gradescope lets i
16.
by arjun810 11y ago
Gradescope - https://gradescope.com Berkeley, CA | ONSITE Gradescope lets instructors give out the same paper-based assignments they've always used, but then grade them online, while keeping track of the exact mistakes made
17.
by arjun810 11y ago
Gradescope - https://gradescope.com Berkeley, CA | ONSITE Gradescope lets instructors give out the same paper-based assignments they've always used, but then grade them online, while keeping track of the exact mistakes made
18.
by arjun810 11y ago
Gradescope - https://gradescope.com Berkeley, CA | on-site only Learning has been assessed in the same way for decades: instructors give out assignments, tediously grade them by hand, and return them to students. With this proce
19.
by arjun810 11y ago
Gradescope - https://gradescope.com Berkeley, CA | on-site only Learning has been assessed in the same way for decades: instructors give out paper-based assignments, tediously grade them by hand, and return them to students. Wit