3 ms·

To me this looks more like a competitor to CodaLab than Kaggle, and seems to target the ML research competition market. It seems unlike Kaggle, it doesn't seem

To me this looks more like a competitor to CodaLab than Kaggle, and seems to target the ML research competition market. It seems unlike Kaggle, it doesn't seem to support things like notebooks, discussions, etc. I might add that the comparison to Kaggle is added by the OP, I don't see it mentioned on the website anywhere.

studentrob 5y ago
> the comparison to Kaggle is added by the OP, I don't see it mentioned on the website anywhere It's on their github page, https://github.com/Cloud-CV/EvalAI#platform-comparison https://github.com/Cloud-CV/EvalAI#platform-comparison
- tmabraham 5y ago
  Ah that's unfortunate, I didn't know. That said, my point still stands. Additionally, the comparison they did is massively unfair. I'm pretty sure Kaggle competitions have most of the feature they claim it doesn't have (ex: multiple phases, custom metrics, evaluation in environments).
  - studentrob 5y ago
    > Ah that's unfortunate, I didn't know. No sweat, we can't know everything, god save the interwebs! > the comparison they did is massively unfair. Agreed. This is all puff
  - lopuhin 5y ago
    Kaggle has two parts - more popular "featured" competitions which have most of those features, but cost money to host. And then also self-hosted competitions which indeed lack all those features and are more relevant for this comparison IMO.
- seasily 5y ago
  Their comparison chart is outright defamatory, as Kaggle features all of the below: Custom metrics Multiple phases/splits Remote evaluation Human evaluation Evaluation in Environments The actual rankings are: #1 Kaggle #2 DrivenData Honorable mention but poorly managed: AiCrowd No one else has any level of funding to incent performance.
  - retrovrv 5y ago
    The comparison is indeed quite old and hasn't been updated. I work with AIcrowd and would love to know why you think it is poorly managed. I know we have a long way to go!

studentrob 5y ago

> the comparison to Kaggle is added by the OP, I don't see it mentioned on the website anywhere It's on their github page, https://github.com/Cloud-CV/EvalAI#platform-comparison https://github.com/Cloud-CV/EvalAI#platform-comparison

tmabraham 5y ago
Ah that's unfortunate, I didn't know. That said, my point still stands. Additionally, the comparison they did is massively unfair. I'm pretty sure Kaggle competitions have most of the feature they claim it doesn't have (ex: multiple phases, custom metrics, evaluation in environments).
- studentrob 5y ago
  > Ah that's unfortunate, I didn't know. No sweat, we can't know everything, god save the interwebs! > the comparison they did is massively unfair. Agreed. This is all puff
- lopuhin 5y ago
  Kaggle has two parts - more popular "featured" competitions which have most of those features, but cost money to host. And then also self-hosted competitions which indeed lack all those features and are more relevant for this comparison IMO.
seasily 5y ago
Their comparison chart is outright defamatory, as Kaggle features all of the below: Custom metrics Multiple phases/splits Remote evaluation Human evaluation Evaluation in Environments The actual rankings are: #1 Kaggle #2 DrivenData Honorable mention but poorly managed: AiCrowd No one else has any level of funding to incent performance.
- retrovrv 5y ago
  The comparison is indeed quite old and hasn't been updated. I work with AIcrowd and would love to know why you think it is poorly managed. I know we have a long way to go!