论文标题

评估模型:交互式教育系统的基本培训任务

Assessment Modeling: Fundamental Pre-training Tasks for Interactive Educational Systems

论文作者

Choi, Youngduck, Lee, Youngnam, Cho, Junghyun, Baek, Jineon, Shin, Dongmin, Yu, Hangyeol, Shim, Yugeun, Lee, Seewoo, Shin, Jonghun, Bae, Chan, Kim, Byungsoo, Heo, Jaewe

论文摘要

像许多人工智能(AI)中的许多其他领域一样,在教育领域(AIED)领域也有特定的任务,标签稀缺且昂贵,例如预测考试成绩或审查正确性。规避标签筛选问题的一种常见方法是预训练一个模型,以了解学习项目内容的表示。但是,这种方法无法利用可用的全部学生互动数据,也不会对学生学习行为进行建模。为此,我们提出了评估建模,这是一类通用互动教育系统的基本培训培训任务。评估是学生系统互动的特征,可以用作教学评估。例子包括学生答案的正确性和及时性。评估建模是根据互动背景下的评估的预测。尽管对大量可用的交互式特征进行预先培训是很自然的,但是将预测目标限制在评估中却将任务与标签 - 筛分的教育问题相关,并减少了相关的噪音。虽然评估组合组合的有效性是开放的,但我们建议评估建模作为为标签 - 筛分教育问题选择适当培训任务的一阶指导原则。

Like many other domains in Artificial Intelligence (AI), there are specific tasks in the field of AI in Education (AIEd) for which labels are scarce and expensive, such as predicting exam score or review correctness. A common way of circumventing label-scarce problems is pre-training a model to learn representations of the contents of learning items. However, such methods fail to utilize the full range of student interaction data available and do not model student learning behavior. To this end, we propose Assessment Modeling, a class of fundamental pre-training tasks for general interactive educational systems. An assessment is a feature of student-system interactions which can serve as a pedagogical evaluation. Examples include the correctness and timeliness of a student's answer. Assessment Modeling is the prediction of assessments conditioned on the surrounding context of interactions. Although it is natural to pre-train on interactive features available in large amounts, limiting the prediction targets to assessments focuses the tasks' relevance to the label-scarce educational problems and reduces less-relevant noise. While the effectiveness of different combinations of assessments is open for exploration, we suggest Assessment Modeling as a first-order guiding principle for selecting proper pre-training tasks for label-scarce educational problems.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源