SemEval 2022 Task 11: MultiCoNER Multilingual Complex Named Entity Recognition

Recent Updates

Feb 8, 2022 Please check out this page for information on paper submission.
Feb 5, 2022 Rankings are out.
Jan 25, 2022 Test phase duration is increased by 2 days. New end date Jan 30 23:59 UTC.
Jan 04, 2022 FAQs about test phase are answered.
Oct 28, 2021 Submission site on Codalab is open now. Register now!
Oct 25, 2021 Updated information on participation and preparing submissions.
Sep 10, 2021 A Baseline system with dev set results is available.
Join us in Slack.
Sep 03, 2021 Training data is available.
Aug 23, 2021 Competition page has some trial data.

Important Dates

* All deadlines are calculated at 11:59 pm
UTC-12 hours

Trial Data Ready	~~Jul 31 (Sat), 2021~~
Training Data Ready	~~Sep 3 (Fri), 2021~~
Evaluation Start	~~Jan 24 (Mon), 2022~~
Evaluation End	~~Jan 30 (Sun), 2022~~
System Description Paper Submission Due	~~Feb 28 (Mon), 2022~~
Notification to Authors	~~Mar 31 (Thu), 2022~~
Camera-ready Due	Apr 21 (Thu), 2022
Workshop	14-15 July 2022 co-located with NAACL

Regardless of the ranking, each participating tips are encouraged to write and submit a system description paper. Here are some information about the paper submission process:

Papers should be submitted to Openreview submission site.
SemEval has a set of requirements about papers. Please find these here.
SemEval provided a set of guidelines for writing a paper here.
As SemEval 2022 will be collocated with NAACL 2022, papers need to be written using the ACL Rolling Review (ARR) template. Please make sure to read the ARR CFP guidelines.

We are providing a customized template based on the ARR template. It is strongly recommended to use this template.

Every system description paper title should follow this format: {TEAM NAME} at SemEval-2022 Task 11: {Paper Title}.
Please use the following bibtex entries to cite the task and the dataset, repectively.

@inproceedings{multiconer-report,
    title={{SemEval-2022 Task 11: Multilingual Complex Named Entity Recognition (MultiCoNER)}},
    author={Malmasi, Shervin and Fang, Anjie and Fetahu, Besnik and Kar, Sudipta and Rokhlenko, Oleg},
    booktitle={Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022)},
    year={2022},
    publisher={Association for Computational Linguistics},
}

@article{multiconer-data,
    title={{MultiCoNER: a Large-scale Multilingual dataset for Complex Named Entity Recognition}},
    author={Malmasi, Shervin and Fang, Anjie and Fetahu, Besnik and Kar, Sudipta and Rokhlenko, Oleg},
    year={2022},
}

Tips for writing a good system description paper

Clearly describe the problem you are trying to solve, what is the dataset, and mention the motivation behind your system design.
Investigating the strengths and weaknesses of a system and listing them in the paper is helpful for future studies. An error analysis section is highly encouraged that will outline where the system works best and what are the cases where it fails. Is there any noticeable patterns in the mistakes?
For the beginners, it is always beneficial to look at some other system description papers. Here are some papers that won the best paper awards in SemEval. Reading these can give an idea on what are the characteristics of a good paper.
Historical SemEval papers can be found here.
Utilize spelling and grammar checker tools.

We are looking forward to your paper submissions. The deadline is February 28, 23:59 UTC-12.

Communication

Join us in Slack
Subscribe to the task mailing list
Contact the organizers