论文标题
科学文献中的方法和数据集实体采矿:具有自我注意力的CNN + BI-LSTM模型
Method and Dataset Entity Mining in Scientific Literature: A CNN + Bi-LSTM Model with Self-attention
论文作者
论文摘要
文献分析促进了研究人员对科学和技术发展的良好理解。传统的文献分析主要集中在文献元数据上,例如主题,作者,摘要,关键词,参考等,并且很少关注论文的主要内容。在许多科学,计算,工程等等科学领域中,这些域中发表的科学论文中涉及的方法和数据集具有重要的信息,并且对于域分析以及算法和数据集建议非常有用。在本文中,我们提出了一个名为MDER的新型实体识别模型,该模型能够从科学论文的主要文本内容中有效地提取方法和数据集实体。该模型利用规则嵌入,并采用具有自发机制的CNN和BI-LSTM的平行结构。我们评估了数据集上的拟议模型,这些模型是根据计算机科学四个研究领域的发表论文构建的,即NLP,CV,数据挖掘和AI。实验结果表明,我们的模型在所有四个领域都表现良好,并且具有良好的学习能力,可实现跨区域的学习和认可。我们还进行了实验,以评估模型中不同建筑物模块的有效性,这表明不同建筑模块在共同为整体上促进良好实体识别性能方面的重要性。我们模型上的数据增强实验表明,数据增强对模型培训有效,使我们的模型在处理仅少量培训样本的情况下更加强大。最终,我们将模型应用于2009 - 2019年发表的PAKDD论文,以挖掘较长时间范围内发表的科学论文的有见地的结果。
Literature analysis facilitates researchers to acquire a good understanding of the development of science and technology. The traditional literature analysis focuses largely on the literature metadata such as topics, authors, abstracts, keywords, references, etc., and little attention was paid to the main content of papers. In many scientific domains such as science, computing, engineering, etc., the methods and datasets involved in the scientific papers published in those domains carry important information and are quite useful for domain analysis as well as algorithm and dataset recommendation. In this paper, we propose a novel entity recognition model, called MDER, which is able to effectively extract the method and dataset entities from the main textual content of scientific papers. The model utilizes rule embedding and adopts a parallel structure of CNN and Bi-LSTM with the self-attention mechanism. We evaluate the proposed model on datasets which are constructed from the published papers of four research areas in computer science, i.e., NLP, CV, Data Mining and AI. The experimental results demonstrate that our model performs well in all the four areas and it features a good learning capacity for cross-area learning and recognition. We also conduct experiments to evaluate the effectiveness of different building modules within our model which indicate that the importance of different building modules in collectively contributing to the good entity recognition performance as a whole. The data augmentation experiments on our model demonstrated that data augmentation positively contributes to model training, making our model much more robust in dealing with the scenarios where only small number of training samples are available. We finally apply our model on PAKDD papers published from 2009-2019 to mine insightful results from scientific papers published in a longer time span.