3 ms·

So -1 -- 5 with the comment box right? how do you account for nicer/meaner do you smooth based on average review for that person's reviews?

• pg 14y ago
  After doing this 16 times we have similar standards, so in practice we don't have to account for easy vs tough graders statistically. We do try to convince other partners to change their votes in borderline cases though. In the last phase we look at all the applications straddling the cutoff for the number of groups we can invite, and try to come closer to a consensus about what side of the cutoff each group should end up on.
  • jayzalowitz 14y ago
    One of your founders relayed to me that they were doing some of the application reading/judging, my concern was there. guess he was pulling my leg.
    • pg 14y ago
      No, he was probably telling the truth. The alumni do the first pass. But (a) they just vote no or maybe, (b) each application is seen by at least 3 alumni, and isn't filtered out till it has at least 2 more nos than maybes, and (c) we look at their overall stats to make sure no one is giving all nos.
      • djt 14y ago
        Sounds sensible. We do the same with resumes and it works well to filter the noise.
      • vbv 14y ago
        pg don't you think the alumni would be biased towards startups/people they know. Or say no to those that could potentially become their competitors in the future.
        • emmett 14y ago
          There's a recuse button if you're conflicted.