TY - GEN
T1 - A Novel Graph Augmentation for Semi-Supervised Learning on Skeleton-Based Action Recognition
AU - Chou, Po Yung
AU - Huang, Hung Chin
AU - Lin, Cheng Hung
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - In recent years, skeleton-based action recognition has become popular due to its higher data precision and resistance to environmental noise compared to RGB-based methods. However, the cost of annotating accurate skeleton video data is quite high. This difficulty often leads to suboptimal training in supervised learning algorithms. In this study, we propose an efficient data augmentation method for skeleton data and combine it with semi-supervised learning strategies to confront the issue of low-labeled skeleton data in action recognition. Moreover, we optimize the schedule for incorporating unlabeled data into the model training process. This approach ensures both model performance and reduces training time effectively. In experiments utilizing a low amount of labeled data from the NTU RGB+D dataset, our proposed method achieved an accuracy of 81.57% with only 10 labeled samples per class. This compares favorably to the original method's accuracy of 77.5%. Furthermore, with 600 labeled samples, our method improved the original result of 90.31% to 92.03%. Although the gap in improvement narrows as the number of labeled samples increases, our proposed augmentation method successfully enhances the performance of the semi-supervised learning method in skeleton-based action recognition. This opens the door to more efficient labeling in skeleton-based action recognition and improves the algorithm's practicality in real-world scenarios.
AB - In recent years, skeleton-based action recognition has become popular due to its higher data precision and resistance to environmental noise compared to RGB-based methods. However, the cost of annotating accurate skeleton video data is quite high. This difficulty often leads to suboptimal training in supervised learning algorithms. In this study, we propose an efficient data augmentation method for skeleton data and combine it with semi-supervised learning strategies to confront the issue of low-labeled skeleton data in action recognition. Moreover, we optimize the schedule for incorporating unlabeled data into the model training process. This approach ensures both model performance and reduces training time effectively. In experiments utilizing a low amount of labeled data from the NTU RGB+D dataset, our proposed method achieved an accuracy of 81.57% with only 10 labeled samples per class. This compares favorably to the original method's accuracy of 77.5%. Furthermore, with 600 labeled samples, our method improved the original result of 90.31% to 92.03%. Although the gap in improvement narrows as the number of labeled samples increases, our proposed augmentation method successfully enhances the performance of the semi-supervised learning method in skeleton-based action recognition. This opens the door to more efficient labeling in skeleton-based action recognition and improves the algorithm's practicality in real-world scenarios.
KW - Data Augmentation
KW - Data Efficientcy
KW - Semi-supervised Learning
KW - Skeleton-based Action Recognition
UR - http://www.scopus.com/inward/record.url?scp=85182937670&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85182937670&partnerID=8YFLogxK
U2 - 10.1109/ICCE-Berlin58801.2023.10375679
DO - 10.1109/ICCE-Berlin58801.2023.10375679
M3 - Conference contribution
AN - SCOPUS:85182937670
T3 - IEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin
SP - 193
EP - 197
BT - 2023 IEEE 13th International Conference on Consumer Electronics - Berlin, ICCE-Berlin 2023
PB - IEEE Computer Society
T2 - 13th IEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin 2023
Y2 - 4 September 2022 through 5 September 2022
ER -