Loading
Cookies help us deliver our services. By using our services, you agree to our use of cookies. Learn more

crowdAI is shutting down - please read our blog post for more information

OpenSNP Height Prediction

OpenSNP


Completed
1275
Submissions
138
Participants
15641
Views

What will be the criterion used in final ranking ?

Posted by sshkhr over 2 years ago

Hello organizers,

As mentioned in the evaluation criteria as well as displayed on the leaderboard, both Co-efficient of Determination and Mean Squared Error are being used to judge the submissions. I wanted to know the final criteria which will be used to rank the participants (on 100% of the test dataset). I believe knowing this will help us train our models suitably.

Best Regards, Shashank

Posted by spMohanty  over 2 years ago |  Quote

The final criterion will still be $R^2$ in case two participants have the exact same $R^2$, then they will be ranked based on the Mean Squared Error.

Cheers, Mohanty

1

Posted by SergeKrier  about 2 years ago |  Quote

The final criterion will still be $R^2$ in case two participants have the exact same $R^2$, then they will be ranked based on the Mean Squared Error.

Since R2 is a direct function of MSE, if 2 submissions have the same R2, their MSE is also equal or did I miss something ?

Posted by TimoD  about 2 years ago |  Quote

Teraflops should be right. Oddly enough, the complete ranking of R^2 is similar to the MSE ranking except for my submission. R^2 is 10th but based on MSE the final ranking should be 7th. Could you give some explanation to this?