Multiple Master-Slave FPGA Architecture of a Stereo Visual Odometry

Chiang Heng Chien, Chen Chien James Hsu, Chiang Ju Chien*

*此作品的通信作者

研究成果: 雜誌貢獻期刊論文同行評審

摘要

Estimating relative camera pose is the key problem of visual odometry (VO). To achieve better efficiency, sparse key-points are usually relied on for the estimation. Yet, feature extraction and matching are still computationally demanding, hindering the overall VO from real-time processing. Exploiting the superiorities of an FPGA in terms of high efficiency, low power consumption, and low cost, this paper proposes a multiple master-slave FPGA architecture for an SIFT-based stereo VO. The master-slave design enables high reconfiguration for the data throughputs among various modules. These modules include SIFT, matching, pose estimation, and their corresponding controllers. In the SIFT module, hardware implemented image pyramid is proposed, where scales are determined off-line via a minimization approach. Local linear exhausted search (LES) matching is considered for both the stereo and the frame matching. In the pose estimation module, a novel hardware design of deriving closest orthogonal matrix for 3D-3D correspondences of relative pose estimation is proposed. Experimental results show that 33.2 fps can be achieved using KITTI dataset without the need of a large number of hardware resources. The proposed reconfigurable design also facilitates its expansions of adopting CCD cameras as well as developing SLAM and other applications.

原文英語
文章編號9492095
頁(從 - 到)103266-103278
頁數13
期刊IEEE Access
9
DOIs
出版狀態已發佈 - 2021

ASJC Scopus subject areas

  • 電腦科學(全部)
  • 材料科學(全部)
  • 工程 (全部)

指紋

深入研究「Multiple Master-Slave FPGA Architecture of a Stereo Visual Odometry」主題。共同形成了獨特的指紋。

引用此