A Novel Graph Augmentation for Semi-Supervised Learning on Skeleton-Based Action Recognition

Po Yung Chou, Hung Chin Huang, Cheng Hung Lin*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In recent years, skeleton-based action recognition has become popular due to its higher data precision and resistance to environmental noise compared to RGB-based methods. However, the cost of annotating accurate skeleton video data is quite high. This difficulty often leads to suboptimal training in supervised learning algorithms. In this study, we propose an efficient data augmentation method for skeleton data and combine it with semi-supervised learning strategies to confront the issue of low-labeled skeleton data in action recognition. Moreover, we optimize the schedule for incorporating unlabeled data into the model training process. This approach ensures both model performance and reduces training time effectively. In experiments utilizing a low amount of labeled data from the NTU RGB+D dataset, our proposed method achieved an accuracy of 81.57% with only 10 labeled samples per class. This compares favorably to the original method's accuracy of 77.5%. Furthermore, with 600 labeled samples, our method improved the original result of 90.31% to 92.03%. Although the gap in improvement narrows as the number of labeled samples increases, our proposed augmentation method successfully enhances the performance of the semi-supervised learning method in skeleton-based action recognition. This opens the door to more efficient labeling in skeleton-based action recognition and improves the algorithm's practicality in real-world scenarios.

Original languageEnglish
Title of host publication2023 IEEE 13th International Conference on Consumer Electronics - Berlin, ICCE-Berlin 2023
PublisherIEEE Computer Society
Pages193-197
Number of pages5
ISBN (Electronic)9798350324150
DOIs
Publication statusPublished - 2023
Event13th IEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin 2023 - Berlin, Germany
Duration: 2022 Sept 42022 Sept 5

Publication series

NameIEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin
ISSN (Print)2166-6814
ISSN (Electronic)2166-6822

Conference

Conference13th IEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin 2023
Country/TerritoryGermany
CityBerlin
Period2022/09/042022/09/05

Keywords

  • Data Augmentation
  • Data Efficientcy
  • Semi-supervised Learning
  • Skeleton-based Action Recognition

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Industrial and Manufacturing Engineering
  • Media Technology

Fingerprint

Dive into the research topics of 'A Novel Graph Augmentation for Semi-Supervised Learning on Skeleton-Based Action Recognition'. Together they form a unique fingerprint.

Cite this