Hand Gesture Recognition Based on Keypoint Vector

Arwoko, Heru and Yuniarno, Eko Mulyanto and Mauridhi, Hery Purnomo (2022) Hand Gesture Recognition Based on Keypoint Vector. In: 2022 International Electronics Symposium (IES), 09-11 August 2022, Surabaya.

PDF Hand_Gesture_Recognition_Based_on_Keypoint_Vector.pdf Download (1MB)

Abstract

Human-computer interaction (HCI) is usually associated with using popular input devices such as a mouse or keyboard. In other cases hand gestures can actually be useful for human-computer interaction when hand gestures are needed to make the game controls more interesting. There are three basic controls as input mouse: move, click, and drag. Hand gestures and hand shape are different for each person. This becomes a problem during automatic recognition. Recent research has proven the success of the Deep Neural Network (DNN) for representation and high accuracy in hand gesture recognition. DNN algorithms can study complex and nonlinear relationships between features by applying multiple layers. This paper proposes hand feature based on the normalized keypoint vector using DNN. The model was trained on 2250 hand datasets which were divided into 3 classes to identify the mouse movement. The network design uses multilayer with neuron sizes (13, 12, 15, 14) with 500 epochs and achieves the best accuracy of 98.5% for normalized features. The important work in this research is the use of keypoint vector from hand gestures as features to be fed to the DNN to achieve good accuracy.

Item Type:	Conference or Workshop Item (Paper)
Uncontrolled Keywords:	Hand Gesture Recognition, Keypoint, Normalized Vector, Deep Neural Networ
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:	Faculty of Engineering > Department of Informatic
Depositing User:	Heru Arwoko 6133
Date Deposited:	17 Jan 2023 10:47
Last Modified:	17 Jan 2023 10:47
URI:	http://repository.ubaya.ac.id/id/eprint/43135

Actions (login required)

View Item