论文标题
DMCNET:多元化的模型组合网络,用于了解视频筛选的参与度
DMCNet: Diversified Model Combination Network for Understanding Engagement from Video Screengrabs
论文作者
论文摘要
参与是学习质量经验(QOLE)的必要指标,并且在开发智能教育界面中起着重要作用。通过大规模开放的在线课程(MOOC)和其他在线资源学习的人数正在迅速增加,因为他们为我们提供了随时随地学习的灵活性。这为学生提供了良好的学习体验。但是,这样的学习界面需要能够识别学生的参与度以获得整体学习经验。这对学生和教育工作者都很有用。但是,由于其主观性和收集数据的能力,了解参与度是一项具有挑战性的任务。在本文中,我们提出了各种模型,这些模型已在视频屏幕截图的开源数据集上进行了培训。我们的非深度学习模型基于流行算法的组合,例如定向梯度的直方图(HOG),支持向量机(SVM),比例尺不变特征变换(SIFT)和加快了强大特征(Surf)。深度学习方法包括密度连接的卷积网络(Densenet-121),残留网络(RESNET-18)和MobilenetV1。我们使用各种指标(例如GINI索引,调整后的F-Measure(AGF)和接收器操作特征曲线(AUC))显示了每个模型的性能。我们使用各种维度降低技术,例如主成分分析(PCA)和T-分布的随机邻居嵌入(T-SNE),以了解特征子空间中数据的分布。我们的工作将协助教育者和学生获得富有成效,高效的在线学习经验。
Engagement is an essential indicator of the Quality-of-Learning Experience (QoLE) and plays a major role in developing intelligent educational interfaces. The number of people learning through Massively Open Online Courses (MOOCs) and other online resources has been increasing rapidly because they provide us with the flexibility to learn from anywhere at any time. This provides a good learning experience for the students. However, such learning interface requires the ability to recognize the level of engagement of the students for a holistic learning experience. This is useful for both students and educators alike. However, understanding engagement is a challenging task, because of its subjectivity and ability to collect data. In this paper, we propose a variety of models that have been trained on an open-source dataset of video screengrabs. Our non-deep learning models are based on the combination of popular algorithms such as Histogram of Oriented Gradient (HOG), Support Vector Machine (SVM), Scale Invariant Feature Transform (SIFT) and Speeded Up Robust Features (SURF). The deep learning methods include Densely Connected Convolutional Networks (DenseNet-121), Residual Network (ResNet-18) and MobileNetV1. We show the performance of each models using a variety of metrics such as the Gini Index, Adjusted F-Measure (AGF), and Area Under receiver operating characteristic Curve (AUC). We use various dimensionality reduction techniques such as Principal Component Analysis (PCA) and t-Distributed Stochastic Neighbor Embedding (t-SNE) to understand the distribution of data in the feature sub-space. Our work will thereby assist the educators and students in obtaining a fruitful and efficient online learning experience.