Hardware-Software Co-Design of an Image Feature Extraction and Matching Algorithm

Chiang Heng Chien, Chiang Ju Chien, Chen Chien Hsu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Providing low cost and rich information, visual sensors are becoming the top choice for automatic systems. Particularly in the field of navigations or SLAM technologies, extracting and matching features are the basic aspects. This paper addresses the required computational efficiency, computational resources and power-consumption problem of image feature detection and matching algorithm by designing a hardware-software co-design architecture for the implementation on a field-programmable gate array (FPGA) and a Nios II CPU. Given images data from the Nios II, features are extracted and matched by the scale-invariant feature transform (SIFT) algorithm and a linear exhaustive search (LES) method using an Altera DE2i-150 FPGA, respectively. The matched features are subsequently transferred back from the FPGA to Nios II. To show the effectiveness of the proposed approach, two images with affine transformations are provided. An object tracking system is also developed. Experimental results show that, taking the advantages of parallel computing of an FPGA, the overall computational time and the hardware resources usage of the proposed approach are greatly reduced, compared to a full-software implementation and other existing methods.

Original languageEnglish
Title of host publicationProceedings - 2019 2nd International Conference on Intelligent Autonomous Systems, ICoIAS 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages37-41
Number of pages5
ISBN (Electronic)9781728126623
DOIs
Publication statusPublished - 2019 Feb
Event2nd International Conference on Intelligent Autonomous Systems, ICoIAS 2019 - Singapore, Singapore
Duration: 2019 Feb 282019 Mar 2

Publication series

NameProceedings - 2019 2nd International Conference on Intelligent Autonomous Systems, ICoIAS 2019

Conference

Conference2nd International Conference on Intelligent Autonomous Systems, ICoIAS 2019
CountrySingapore
CitySingapore
Period19/2/2819/3/2

    Fingerprint

Keywords

  • FPGA
  • LES
  • Nios
  • SIFT
  • feature detection and matching
  • hardware-software co-design
  • object tracking

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Hardware and Architecture
  • Automotive Engineering
  • Control and Optimization

Cite this

Chien, C. H., Chien, C. J., & Hsu, C. C. (2019). Hardware-Software Co-Design of an Image Feature Extraction and Matching Algorithm. In Proceedings - 2019 2nd International Conference on Intelligent Autonomous Systems, ICoIAS 2019 (pp. 37-41). [8782443] (Proceedings - 2019 2nd International Conference on Intelligent Autonomous Systems, ICoIAS 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICoIAS.2019.00013