Recent Updates
- Feb 20, 2023 Papers should be submitted here
- Feb 7, 2023 Please check out this page for information on paper submission.
- Feb 7, 2023 Rankings are out.
- Jan 25, 2023 Evaluation phase is extended by 24 hours. This phase will end on February 1st 11:59 pm AOE.
- Jan 25, 2023 Evaluation phase site with test data is available in Codalab.
- Jan 18, 2023 Practice phase site on Codalab is open now.
Important Dates
| Trial Data Ready |
|
| Training Data Ready |
|
| Evaluation Start |
|
| Evaluation End |
|
| System Description Paper Submission Due |
|
| Notification to Authors | Mar 31 (Fri), 2023 |
| Camera-ready Due | Apr 21 (Fri), 2023 |
| Workshop | 13-14 July 2023 co-located with ACL |
Regardless of the ranking, each participating tips are encouraged to write and submit a system description paper. Here are some information about the paper submission process:
- Papers should be submitted here.
- SemEval has a set of requirements about papers. Please find these here.
- SemEval provided a set of guidelines for writing a paper here.
We are providing a customized template based on the ARR template. It is strongly recommended to use this template.
-
Every system description paper title should follow this format: {TEAM NAME} at SemEval-2023 Task 2: {Paper Title}.
-
Please use the following bibtex entries to cite the task and the dataset, repectively. As this edition is an iteration over the previous edition of MultiCoNER, please cite the task and dataset papers of the former edition.
@inproceedings{multiconer2-report,
title={{SemEval-2023 Task 2: Fine-grained Multilingual Named Entity Recognition (MultiCoNER 2)}},
author={Fetahu, Besnik and Kar, Sudipta and Chen, Zhiyu and Rokhlenko, Oleg and Malmasi, Shervin},
booktitle={Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)},
year={2023},
publisher={Association for Computational Linguistics},
}
@article{multiconer2-data,
title={{MultiCoNER v2: a Large Multilingual dataset for Fine-grained and Noisy Named Entity Recognition}},
author={Fetahu, Besnik and Chen, Zhiyu and Kar, Sudipta and Rokhlenko, Oleg and Malmasi, Shervin},
year={2023},
}
@inproceedings{malmasi-etal-2022-semeval,
title = "{S}em{E}val-2022 Task 11: Multilingual Complex Named Entity Recognition ({M}ulti{C}o{NER})",
author = "Malmasi, Shervin and
Fang, Anjie and
Fetahu, Besnik and
Kar, Sudipta and
Rokhlenko, Oleg",
booktitle = "Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022)",
month = jul,
year = "2022",
address = "Seattle, United States",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2022.semeval-1.196",
doi = "10.18653/v1/2022.semeval-1.196",
pages = "1412--1437"
}
@inproceedings{malmasi-etal-2022-multiconer,
title = "{M}ulti{C}o{NER}: A Large-scale Multilingual Dataset for Complex Named Entity Recognition",
author = "Malmasi, Shervin and
Fang, Anjie and
Fetahu, Besnik and
Kar, Sudipta and
Rokhlenko, Oleg",
booktitle = "Proceedings of the 29th International Conference on Computational Linguistics",
month = oct,
year = "2022",
address = "Gyeongju, Republic of Korea",
publisher = "International Committee on Computational Linguistics",
url = "https://aclanthology.org/2022.coling-1.334",
pages = "3798--3809"
}
Tips for writing a good system description paper
- Clearly describe the problem you are trying to solve, what is the dataset, and mention the motivation behind your system design.
- Investigating the strengths and weaknesses of a system and listing them in the paper is helpful for future studies. An error analysis section is highly encouraged that will outline where the system works best and what are the cases where it fails. Is there any noticeable patterns in the mistakes?
-
For the beginners, it is always beneficial to look at some other system description papers. Here are some papers that won the best paper awards in SemEval. Reading these can give an idea on what are the characteristics of a good paper.
Historical SemEval papers can be found here. - Check out some papers from the previous editions of MultiCoNER (SemEval 2022 Task 11) here.
- Utilize spelling and grammar checker tools.
We are looking forward to your paper submissions. The deadline is February 28, 23:59 UTC-12.
Communication
-
Join us in Slack
-
Subscribe to the task mailing list