A Multi-task Approach for Machine Reading Comprehension Form Named Entity Recognition Tasks

DOI

10.2991/978-94-6463-040-4_73How to use a DOI?

Keywords

Named Entity Recognition; Multi-task Learning; Natural Language Inference

Abstract

Named Entity Recognition (NER) is a basic NLP task that aims to provide class labels for words in free text, such as people, locations. The traditional NER task is treated as a label-sequence task, but the trend of recent jobs is to convert the NER task into a Machine Reading Comprehension (MRC) task to achieve better representation. However, this conversion is often accompanied by the problem of poor generalization of the model due to too few class-specific instances. Therefore, to solve this problem, we try to introduce different domain knowledge into our NER task, and we introduce MRC knowledge as well as NLI knowledge into our NER task through a multi-task learning approach. Our method is a one-stage model that combines two large NLI datasets (MNLI, SNLI) and a large traditional MRC dataset (SquAD) with our target NER dataset for multi-task learning. Through multi task learning, we learn the knowledge of NLI domain and MRC domain, so as to improve the performance of our model on the target dataset. We conducted enough experiments to validate the effectiveness of our method. Also, our model achieves 0.3% and 0.106% improvement compared to different baselines, respectively, proving that introducing external knowledge is effective in improving model performance.

Copyright

© 2023 The Author(s)

Open Access

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

TY  - CONF
AU  - Yu Zhang
AU  - Jian Deng
AU  - Ying Ma
AU  - Jianmin Li
PY  - 2022
DA  - 2022/12/27
TI  - A Multi-task Approach for Machine Reading Comprehension Form Named Entity Recognition Tasks
BT  - Proceedings of the 2022 3rd International Conference on Artificial Intelligence and Education (IC-ICAIE 2022)
PB  - Atlantis Press
SP  - 480
EP  - 485
SN  - 2589-4900
UR  - https://doi.org/10.2991/978-94-6463-040-4_73
DO  - 10.2991/978-94-6463-040-4_73
ID  - Zhang2022
ER  -