A Transformer-based Object Relationship Finder for Object Status Analysis

Po Ying Huang*, Po Yung Chou, Cheng Hung Lin

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Basketball analysis systems are essential tools in modern basketball, where identifying the ball handler is one of the most critical tasks. The reason for this challenge comes from the overlapping of players in basketball, which makes it easy for the analysis system to misjudge the ball handler. We found that it is easy to misjudge ball handler using traditional algorithms, such as calculating the degree of intersection over the union or calculating the coordinate distance between the player and the ball. In this paper, we propose a transformer-based object relationship finder to classify the relationship between players and the ball, which uses features of different objects, such as the use of coordinate information and skeleton information as inputs, to learn the relationship between players and the ball through self-attention. Experimental results show that our method achieves an accuracy of ball handler up to 91.2% based on a smaller dataset, surpassing the 83.9% accuracy of traditional algorithms and the 77.8% accuracy of Resnet-based convolutional neural networks.

Original languageEnglish
Title of host publication2023 International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2023 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages563-564
Number of pages2
ISBN (Electronic)9798350324174
DOIs
Publication statusPublished - 2023
Event2023 International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2023 - Pingtung, Taiwan
Duration: 2023 Jul 172023 Jul 19

Publication series

Name2023 International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2023 - Proceedings

Conference

Conference2023 International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2023
Country/TerritoryTaiwan
CityPingtung
Period2023/07/172023/07/19

Keywords

  • ball handler analysis
  • object relationship
  • self-attention
  • skeleton joints

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Information Systems
  • Information Systems and Management
  • Electrical and Electronic Engineering
  • Media Technology
  • Instrumentation

Fingerprint

Dive into the research topics of 'A Transformer-based Object Relationship Finder for Object Status Analysis'. Together they form a unique fingerprint.

Cite this