Cookies help us deliver our services. By using our services, you agree to our use of cookies. Learn more

crowdAI is shutting down - please read our blog post for more information

Mapping Challenge

Building Missing Maps with Machine Learning


How does the ranking work?

Posted by dennissv almost 4 years ago

Hi, excited to work with this competition!

To start with I just got a quick question regarding the ranking system. I understand the individual scoring parameters of precision and recall but how are they combined to determine rank? Focus on precision, or are they summed, or something?

Posted by spMohanty  almost 4 years ago |  Quote

Hi @dennissv,

They are currently ordered based first on AP, and then on AR. But if you think about it, its going to be rare that the AP of two submissions will effectively be exactly the same (and hence AR is not being actually used at the moment, but used just as a feedback).

In a few weeks, we will be updating the leaderboard to first sort the submissions based on the AP (upto 2 significant digits), and then for submissions which have the same AP (upto 2 significant digits) will be ranked based on AR.

Hope that clarifies your question. Cheers, Mohanty

Posted by dennissv  almost 4 years ago |  Quote

Ok that’s clear, thanks for the answer!