Loading
Cookies help us deliver our services. By using our services, you agree to our use of cookies. Learn more

crowdAI is shutting down - please read our blog post for more information

League of Nations Archives Digitization Challenge

Help us share the archives of the League of Nations, a vital part of world history


Completed
469
Submissions
135
Participants
7090
Views

Error in leaderboard?

Posted by dennissv about 1 year ago

Hello,

I think that the leaderboard is sorted incorrectly. At the moment it considers a low F1 score to be better than a high one.

Posted by dennissv  about 1 year ago |  Quote

Just read that the mean log loss is used as the primary metric so I guess the error is there. At the moment a high log loss is considered better.

Posted by nshreyasvi  about 1 year ago |  Quote

Hello, I think @spMohanty would be able to resolve this query.

Posted by spMohanty  about 1 year ago |  Quote

@dennissv : Sorry for the small inconsistency. The primary scoring metric is F1_score and the secondary scoring metric is the log loss. And I have rechecked the sort orders for the leaderboard.

1