论文标题

自然语言界面的反事实解释

Counterfactual Explanations for Natural Language Interfaces

论文作者

Tolkachev, George, Mell, Stephen, Zdancewic, Steve, Bastani, Osbert

论文摘要

自然语言接口面临的主要挑战是使用户能够了解基础系统的功能。我们提出了一种基于语义解析的自然语言界面的解释的新颖方法。我们专注于反事实解释,这些解释是事后的解释,这些解释向用户描述了他们如何最小化的话语来实现自己的期望目标。特别是,用户提供了一种说法,并展示了他们所需的目标;然后,我们的算法综合了其话语的释义,可以保证实现其目标。在两项用户研究中,我们证明了我们的方法可以大大提高用户性能,并且与两次消融相比,它产生的解释更匹配用户的意图。

A key challenge facing natural language interfaces is enabling users to understand the capabilities of the underlying system. We propose a novel approach for generating explanations of a natural language interface based on semantic parsing. We focus on counterfactual explanations, which are post-hoc explanations that describe to the user how they could have minimally modified their utterance to achieve their desired goal. In particular, the user provides an utterance along with a demonstration of their desired goal; then, our algorithm synthesizes a paraphrase of their utterance that is guaranteed to achieve their goal. In two user studies, we demonstrate that our approach substantially improves user performance, and that it generates explanations that more closely match the user's intent compared to two ablations.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源