Pilates Pose Classification Using MediaPipe and Convolutional Neural Networks with Transfer Learning

Tanjaya, Kenneth Angelo and Naufal, Mohammad Farid and Arwoko, Heru (2023) Pilates Pose Classification Using MediaPipe and Convolutional Neural Networks with Transfer Learning. Jurnal Ilmiah Teknik Elektro Komputer dan Informatika, 9 (2). pp. 212-222. ISSN 2338-3070; E-ISSN 2338-3062

PDF Mohammad Farid Naufal_Pilates Pose Classification.pdf Download (2MB)

Abstract

A sedentary lifestyle can lead to heart disease, cancer, and type 2 diabetes. An anaerobic exercise called pilates can address these problems. Although pilates training can provide health benefits, the heavy load of pilates poses may cause severe muscle injury if not done properly. Surveys have found that many teenagers are unaware of the movements in pilates poses. Therefore, a system is needed to help users classify pilates poses accurately. MediaPipe is a system that accurately extracts the real time human body skeleton. Convolutional Neural Network (CNN) with transfer learning is an accurate method for image classification. There have been several studies investigated pilates poses classification. However, there is still no research applies the MediaPipe as a skeleton feature extractor and CNN with a transfer learning to classify pilates poses. In addition, previous research still does not implement the pilates poses classification in real-time. Based on this problem, this study creates a system using MediaPipe as a feature extractor and CNN with transfer learning as a real-time pilates poses classifier. This system runs on a mobile device and gets information from a camera sensor. The results from MediaPipe then be classified by pre-trained CNN architectures with transfer learning: MobileNetV2, Xception, and ResNet50. The best model was obtained by MobileNetV2, which had an f1 score of 98%. Ten people who didn't know much about Pilates also tested the system. They all agreed that the app could accurately identify Pilates poses, make people more interested in Pilates, and help them learn more about Pilates.

Item Type:	Article
Uncontrolled Keywords:	Pilates; Pose; Classification; Mediapipe; Transfer learning; CNN
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:	Faculty of Engineering > Department of Informatic
Depositing User:	MOHAMMAD FARID NAUFAL
Date Deposited:	18 Apr 2023 05:13
Last Modified:	11 Oct 2024 11:26
URI:	http://repository.ubaya.ac.id/id/eprint/44023

Actions (login required)

View Item