Early predicting of student struggles using body language

Matthew L. Dering, Conrad Tucker

Research output: Contribution to journalConference article

Abstract

The accuracy of RGB-D sensing has enabled many technical achievements in applications such as gamification, task recognition, as well as pedagogical applications. The ability of these sensors to track many body parts simultaneously has introduced a new data modality for analysis. By analyzing body language, this work can predict if a student will struggle in the future, and if an instructor should intervene. To accomplish this, a study is performed to determine how early (after how many seconds) does it become possible to determine if a student will struggle. A simple neural network is proposed which is used to jointly classify body language and predict task performance. By modeling the input as both instances and sequences, a peak F Score of 0.459 was obtained, after observing a student for just two seconds. Finally, an unsupervised method yielded a model which could determine if a student would struggle after just 1 second with 59.9% accuracy.

Original languageEnglish (US)
JournalASEE Annual Conference and Exposition, Conference Proceedings
Volume2017-June
StatePublished - Jun 24 2017
Event124th ASEE Annual Conference and Exposition - Columbus, United States
Duration: Jun 25 2017Jun 28 2017

Fingerprint

Students
Neural networks
Sensors

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Cite this

@article{2205034e28cb42cba6d363eaf85073e6,
title = "Early predicting of student struggles using body language",
abstract = "The accuracy of RGB-D sensing has enabled many technical achievements in applications such as gamification, task recognition, as well as pedagogical applications. The ability of these sensors to track many body parts simultaneously has introduced a new data modality for analysis. By analyzing body language, this work can predict if a student will struggle in the future, and if an instructor should intervene. To accomplish this, a study is performed to determine how early (after how many seconds) does it become possible to determine if a student will struggle. A simple neural network is proposed which is used to jointly classify body language and predict task performance. By modeling the input as both instances and sequences, a peak F Score of 0.459 was obtained, after observing a student for just two seconds. Finally, an unsupervised method yielded a model which could determine if a student would struggle after just 1 second with 59.9{\%} accuracy.",
author = "Dering, {Matthew L.} and Conrad Tucker",
year = "2017",
month = "6",
day = "24",
language = "English (US)",
volume = "2017-June",
journal = "ASEE Annual Conference and Exposition, Conference Proceedings",
issn = "2153-5965",

}

Early predicting of student struggles using body language. / Dering, Matthew L.; Tucker, Conrad.

In: ASEE Annual Conference and Exposition, Conference Proceedings, Vol. 2017-June, 24.06.2017.

Research output: Contribution to journalConference article

TY - JOUR

T1 - Early predicting of student struggles using body language

AU - Dering, Matthew L.

AU - Tucker, Conrad

PY - 2017/6/24

Y1 - 2017/6/24

N2 - The accuracy of RGB-D sensing has enabled many technical achievements in applications such as gamification, task recognition, as well as pedagogical applications. The ability of these sensors to track many body parts simultaneously has introduced a new data modality for analysis. By analyzing body language, this work can predict if a student will struggle in the future, and if an instructor should intervene. To accomplish this, a study is performed to determine how early (after how many seconds) does it become possible to determine if a student will struggle. A simple neural network is proposed which is used to jointly classify body language and predict task performance. By modeling the input as both instances and sequences, a peak F Score of 0.459 was obtained, after observing a student for just two seconds. Finally, an unsupervised method yielded a model which could determine if a student would struggle after just 1 second with 59.9% accuracy.

AB - The accuracy of RGB-D sensing has enabled many technical achievements in applications such as gamification, task recognition, as well as pedagogical applications. The ability of these sensors to track many body parts simultaneously has introduced a new data modality for analysis. By analyzing body language, this work can predict if a student will struggle in the future, and if an instructor should intervene. To accomplish this, a study is performed to determine how early (after how many seconds) does it become possible to determine if a student will struggle. A simple neural network is proposed which is used to jointly classify body language and predict task performance. By modeling the input as both instances and sequences, a peak F Score of 0.459 was obtained, after observing a student for just two seconds. Finally, an unsupervised method yielded a model which could determine if a student would struggle after just 1 second with 59.9% accuracy.

UR - http://www.scopus.com/inward/record.url?scp=85030568108&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85030568108&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:85030568108

VL - 2017-June

JO - ASEE Annual Conference and Exposition, Conference Proceedings

JF - ASEE Annual Conference and Exposition, Conference Proceedings

SN - 2153-5965

ER -