Loading
Cookies help us deliver our services. By using our services, you agree to our use of cookies. Learn more

League of Nations Archives Digitization Challenge

Help us share the archives of the League of Nations, a vital part of world history


Completed
469
Submissions
128
Participants
4955
Views

Error in leaderboard?

Posted by dennissv 5 months ago

Hello,

I think that the leaderboard is sorted incorrectly. At the moment it considers a low F1 score to be better than a high one.

Posted by dennissv  5 months ago |  Quote

Just read that the mean log loss is used as the primary metric so I guess the error is there. At the moment a high log loss is considered better.

Posted by nshreyasvi  5 months ago |  Quote

Hello, I think @spMohanty would be able to resolve this query.

Posted by spMohanty  5 months ago |  Quote

@dennissv : Sorry for the small inconsistency. The primary scoring metric is F1_score and the secondary scoring metric is the log loss. And I have rechecked the sort orders for the leaderboard.

1