Not a benchmark. Just a test with a single task. There is so much variance depending on prompting that single task test does not measure anything. Give 5 diffe

Not a benchmark. Just a test with a single task. There is so much variance depending on prompting that single task test does not measure anything. Give 5 different tasks to 5 different programmers who each can choose to write their own prompts and maybe you start seeing a pattern to emerge.