Vision Transformer-Based Dog Breed Classification with a Hybrid Detection-Classification Framework

Benarkah, Njoto and Siswantoro, Joko and Porayouw, Bryan (2026) Vision Transformer-Based Dog Breed Classification with a Hybrid Detection-Classification Framework. TEKNIKA, 15 (2). ISSN 2549-8037

PDF 9(FINAL)-1484.pdf Download (1MB)

Abstract

Dog breed classification remains a challenging task in computer vision due to high inter-class visual similarity, pose variations, changes in illumination, and complex background conditions. Conventional convolutional neural network (CNN) approaches often struggle to capture global contextual dependencies and subtle discriminative features. This study proposes a hybrid deep learning framework that integrates YOLOv8n for object detection with the Vision Transformer (ViT-B/16) for dog breed classification. The dataset comprises 14,181 dog images collected from the Tsinghua Dogs Dataset and supplementary real- world sources, spanning 10 dog breed categories. The proposed framework includes image preprocessing, data augmentation, transfer learning, and Bayesian hyperparameter optimization using Optuna to enhance model generalization. YOLOv8n is employed to localize dog regions, which are subsequently resized and passed to the Vision Transformer for global feature representation learning. The model is evaluated on 2,133 unseen test images. Experimental results demonstrate that the proposed framework achieves an accuracy of 97.98% with macro and weighted F1-score values of 98.76% and 97.98%, respectively. Comparative experiments against standalone ViT-B/16 and EfficientNetV2M architectures futher confirm the effectiveness of the proposed hybrid YOLOv8n–ViT-B/16 framework for dog breed classification.

Item Type:	Article
Subjects:	Q Science > Q Science (General) Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software Q Science > QL Zoology T Technology > T Technology (General)
Divisions:	Faculty of Engineering > Department of Informatic
Depositing User:	Njoto Benarkah 61120
Date Deposited:	08 Jul 2026 05:20
Last Modified:	08 Jul 2026 05:20
URI:	http://repository.ubaya.ac.id/id/eprint/50923

Actions (login required)

View Item