4 ms·
"show that its better" I've being thinking a lot about this, and I think this is better addressed by using the same standards as in other fields. Namely, a sci
by miltondts 6y ago
"show that its better"
I've being thinking a lot about this, and I think this is better addressed by using the same standards as in other fields. Namely, a scientific study. I imagine an environment like repl.it, with just a simple text editor, and some problem description and a set of compressive tests that serve as a spec. Then we measure time to produce a solution and number times the solution makes the tests fail (bugs). With enough people doing this, and in enough languages, we might be able to reach some conclusions. Until then, we will be stuck in the dark.
- Youden 6y agoThere was a study done by Yale/US Navy/DARPA back in the 90s [0] but it was much more limited than you're describing. [0]: https://www.cs.yale.edu/publications/techreports/tr1049.pdf https://www.cs.yale.edu/publications/techreports/tr1049.pdf