Loading
Cookies help us deliver our services. By using our services, you agree to our use of cookies. Learn more

OpenSNP Height Prediction

OpenSNP


Completed
1275
Submissions
129
Participants
13088
Views

What will be the criterion used in final ranking ?

Posted by sshkhr over 1 year ago

Hello organizers,

As mentioned in the evaluation criteria as well as displayed on the leaderboard, both Co-efficient of Determination and Mean Squared Error are being used to judge the submissions. I wanted to know the final criteria which will be used to rank the participants (on 100% of the test dataset). I believe knowing this will help us train our models suitably.

Best Regards, Shashank

Posted by spMohanty  over 1 year ago |  Quote

The final criterion will still be $R^2$ in case two participants have the exact same $R^2$, then they will be ranked based on the Mean Squared Error.

Cheers, Mohanty

1

Posted by SergeKrier  over 1 year ago |  Quote

The final criterion will still be $R^2$ in case two participants have the exact same $R^2$, then they will be ranked based on the Mean Squared Error.

Since R2 is a direct function of MSE, if 2 submissions have the same R2, their MSE is also equal or did I miss something ?

Posted by TimoD  over 1 year ago |  Quote

Teraflops should be right. Oddly enough, the complete ranking of R^2 is similar to the MSE ranking except for my submission. R^2 is 10th but based on MSE the final ranking should be 7th. Could you give some explanation to this?