Loading
Cookies help us deliver our services. By using our services, you agree to our use of cookies. Learn more

crowdAI is shutting down - please read our blog post for more information

Mapping Challenge

Building Missing Maps with Machine Learning


Completed
719
Submissions
1062
Participants
40193
Views

How does the ranking work?

Posted by dennissv over 1 year ago

Hi, excited to work with this competition!

To start with I just got a quick question regarding the ranking system. I understand the individual scoring parameters of precision and recall but how are they combined to determine rank? Focus on precision, or are they summed, or something?

Posted by spMohanty  over 1 year ago |  Quote

Hi @dennissv,

They are currently ordered based first on AP, and then on AR. But if you think about it, its going to be rare that the AP of two submissions will effectively be exactly the same (and hence AR is not being actually used at the moment, but used just as a feedback).

In a few weeks, we will be updating the leaderboard to first sort the submissions based on the AP (upto 2 significant digits), and then for submissions which have the same AP (upto 2 significant digits) will be ranked based on AR.

Hope that clarifies your question. Cheers, Mohanty

Posted by dennissv  over 1 year ago |  Quote

Ok that’s clear, thanks for the answer!