Facial Expression Recognition to Detect Student Engagement in Online Lectures

Siswantoro, Joko and Rahmadiarto, Januar and Naufal, Mohammad Farid (2024) Facial Expression Recognition to Detect Student Engagement in Online Lectures. Teknika, 13 (2). pp. 226-232. ISSN 2549-8037, E-ISSN 2549-8045

PDF Mohammad Farid Naufal_Facial Expression Recognition.pdf Download (1MB)

Abstract

In synchronous online lectures, the lecturers often provide the lecture material directly through video conference technology. On the other hand, there are many students who do not pay attention to the lecturers when they are participating in online lectures. As a consequence, in this research, an application was developed to assist lecturers in gathering data regarding the degree to which students who participate in online lectures pay attention to the presented information. The application employed a convolutional neural network (CNN) model to recognize each student's facial expressions and place them into one of two classes: either engaged or disengaged. The captured student facial image was preprocessed to facilitate the classification process. The preprocessing stage consisted of image conversion to gray scale, face detection using the Haar-Cascade Classifier model, and a median filter to reduce noise. In the process of designing a CNN model, three different hyperparameter tuning scenarios were implemented. These tuning scenarios aimed to obtain the best possible CNN model by determining which CNN model hyperparameters were the most optimal. The results of the experiments indicate that the CNN model from the second scenario has the highest level of accuracy in terms of recognizing facial expressions, coming in at 86%. The results of this research have been tested to measure the level of student participation in online lectures. The trial results show that the proposed application can help lecturers evaluate student engagement during online lectures.

Item Type:	Article
Uncontrolled Keywords:	Facial Expression Recognition, Convolutional Neural Network, Student Engagement, Online Lectures
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:	Faculty of Engineering > Department of Informatic
Depositing User:	Joko Siswantoro
Date Deposited:	12 Jul 2024 08:31
Last Modified:	14 Oct 2024 01:51
URI:	http://repository.ubaya.ac.id/id/eprint/46708

Actions (login required)

View Item