Skip to content

Commit

Permalink
Merge branch 'main' of github.com:OFAI/GermEval2024-GerMS
Browse files Browse the repository at this point in the history
  • Loading branch information
johann-petrak committed Jun 25, 2024
2 parents 4639e8b + 69856a5 commit 62cc4d4
Show file tree
Hide file tree
Showing 5 changed files with 6 additions and 4 deletions.
Binary file added site/data/germeval-competition-test.jsonl.gz
Binary file not shown.
Binary file added site/data/germeval-competition-traindev.jsonl.gz
Binary file not shown.
4 changes: 3 additions & 1 deletion site/download.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,8 @@ All files are made available under a [CC BY-NC-SA 4.0 License](https://creativec
* [Training Data](data/germeval-development-train.jsonl.gz)
* [Testing Data](data/germeval-development-test.jsonl.gz)

## Competition Phase

* [Training Data](data/germeval-competition-traindev.jsonl.gz)
* [Testing Data](data/germeval-competition-test.jsonl.gz)

## Competition Phase
4 changes: 2 additions & 2 deletions site/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -96,8 +96,8 @@ become available.
* **Competition phase**: June 8 - June 25, 2024
* During this phase, the training data will consist of the training data of the previous phase plus the labeled test data of the previous phase
and a new unlabeled test set is made available. You can upload the labels for
the test set to the competition site and your latest submission will be the one that will be used for ranking. During that phase, the leaderboard is not shown. Please note that only submissions which adhere to all terms and rules are considered for the final ranking.
* A preliminary leaderboard/ranking is shown after the end of the competition phase.
the test set to the competition site and your latest submission will be the one that will be used for ranking. Please note that only submissions which adhere to all terms and rules are considered for the final ranking.
* A preliminary final leaderboard/ranking is shown after the end of the competition phase.
* The final leaderboard/ranking will be available once paper review and final submission is completed, on July 21th 2024.
* **Paper submission due**: July 1, 2024
* **Camera ready due**: July 20, 2024
Expand Down
2 changes: 1 addition & 1 deletion site/terms.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ and the codabench user who made the submission also matches the codabench user n

**Submission of system description papers**: Participants having made at least one submission the Competition Phase will be able to submit a paper describing their system. For the closed track paper submission the open-source code of their solution has to be accessible to the public. We also stronly encourage providing open source solutions for the open track submissions as far as possible.

**Final Competition Ranking**: the final rankings for subtask 1 and subtask 2 are determined after the paper review and camera ready submission have ended.
**Final Competition Ranking**: the final rankings for subtask 1 and subtask 2 are determined after the paper review and camera ready submission have ended. The final ranking may deviate from what is shown on the leaderboard if participants did not adhere to the rules or if the algorithm for scoring submissions had to be updated.
Only submissions for which a paper describing the solution has been submitted and an open source solution is available will be considered in the ranking.
**Please note that if a team has several submissions in the competition phase,
only the latest submission (the one that also shows up on the leaderboard)
Expand Down

0 comments on commit 62cc4d4

Please sign in to comment.