论文标题

对文本摘要的敏感性对人量的文本素质的敏感性

Sensitivity of BLANC to human-scored qualities of text summaries

论文作者

Vasilyev, Oleg, Dharnidharka, Vedant, Egan, Nicholas, Chambliss, Charlene, Bohannon, John

论文摘要

我们探讨了文档摘要质量估计器Blanc对同一摘要的质量评估的敏感性。在我们的人类评估中,我们区分了五个摘要质量,这些质量是由流利,易于理解,信息丰富,紧凑和事实纠正摘要所定义的。我们为最佳的Blanc参数提供了理由,在该参数上,几乎所有摘要质量的敏感性与人类注释者的敏感性一样好。

We explore the sensitivity of a document summary quality estimator, BLANC, to human assessment of qualities for the same summaries. In our human evaluations, we distinguish five summary qualities, defined by how fluent, understandable, informative, compact, and factually correct the summary is. We make the case for optimal BLANC parameters, at which the BLANC sensitivity to almost all of summary qualities is about as good as the sensitivity of a human annotator.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源