Combining textual and visual features for cross-language medical image retrieval

Pei Cheng Cheng, Been Chian Chien, Hao-Ren Ke, Wei Pang Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this paper we describe the technologies and experimental results for the medical retrieval task and automatic annotation task. We combine textual and content-based approaches to retrieve relevant medical images. The content-based approach containing four image features and the text-based approach using word expansion are developed to accomplish these tasks. Experimental results show that combining both the content-based and text-based approaches is better than using only one approach. In the automatic annotation task we use Support Vector Machines (SVM) to learn image feature characteristics for assisting the task of image classification. Based on the SVM model, we analyze which image feature is more promising in medical image retrieval. The results show that the spatial relationship between pixels is an important feature in medical image data because medical image data always has similar anatomic regions. Therefore, image features emphasizing spatial relationship have better results than others.

Original languageEnglish
Title of host publicationAccessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005
PublisherSpringer Verlag
Pages712-723
Number of pages12
ISBN (Print)354045697X, 9783540456971
Publication statusPublished - 2006 Jan 1
EventAccessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005 - Vienna, Austria
Duration: 2005 Sep 212005 Sep 23

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4022 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

OtherAccessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005
CountryAustria
CityVienna
Period05/9/2105/9/23

Fingerprint

Image retrieval
Image Retrieval
Medical Image
Support vector machines
Image classification
Annotation
Support Vector Machine
Pixels
Image Classification
Experimental Results
Retrieval
Pixel
Language
Vision
Relationships
Text
Model

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Cheng, P. C., Chien, B. C., Ke, H-R., & Yang, W. P. (2006). Combining textual and visual features for cross-language medical image retrieval. In Accessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005 (pp. 712-723). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4022 LNCS). Springer Verlag.

Combining textual and visual features for cross-language medical image retrieval. / Cheng, Pei Cheng; Chien, Been Chian; Ke, Hao-Ren; Yang, Wei Pang.

Accessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005. Springer Verlag, 2006. p. 712-723 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4022 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Cheng, PC, Chien, BC, Ke, H-R & Yang, WP 2006, Combining textual and visual features for cross-language medical image retrieval. in Accessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4022 LNCS, Springer Verlag, pp. 712-723, Accessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005, Vienna, Austria, 05/9/21.
Cheng PC, Chien BC, Ke H-R, Yang WP. Combining textual and visual features for cross-language medical image retrieval. In Accessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005. Springer Verlag. 2006. p. 712-723. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Cheng, Pei Cheng ; Chien, Been Chian ; Ke, Hao-Ren ; Yang, Wei Pang. / Combining textual and visual features for cross-language medical image retrieval. Accessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005. Springer Verlag, 2006. pp. 712-723 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{cf146d66cc964db590f6e49ba6b8ce2d,
title = "Combining textual and visual features for cross-language medical image retrieval",
abstract = "In this paper we describe the technologies and experimental results for the medical retrieval task and automatic annotation task. We combine textual and content-based approaches to retrieve relevant medical images. The content-based approach containing four image features and the text-based approach using word expansion are developed to accomplish these tasks. Experimental results show that combining both the content-based and text-based approaches is better than using only one approach. In the automatic annotation task we use Support Vector Machines (SVM) to learn image feature characteristics for assisting the task of image classification. Based on the SVM model, we analyze which image feature is more promising in medical image retrieval. The results show that the spatial relationship between pixels is an important feature in medical image data because medical image data always has similar anatomic regions. Therefore, image features emphasizing spatial relationship have better results than others.",
author = "Cheng, {Pei Cheng} and Chien, {Been Chian} and Hao-Ren Ke and Yang, {Wei Pang}",
year = "2006",
month = "1",
day = "1",
language = "English",
isbn = "354045697X",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "712--723",
booktitle = "Accessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005",

}

TY - GEN

T1 - Combining textual and visual features for cross-language medical image retrieval

AU - Cheng, Pei Cheng

AU - Chien, Been Chian

AU - Ke, Hao-Ren

AU - Yang, Wei Pang

PY - 2006/1/1

Y1 - 2006/1/1

N2 - In this paper we describe the technologies and experimental results for the medical retrieval task and automatic annotation task. We combine textual and content-based approaches to retrieve relevant medical images. The content-based approach containing four image features and the text-based approach using word expansion are developed to accomplish these tasks. Experimental results show that combining both the content-based and text-based approaches is better than using only one approach. In the automatic annotation task we use Support Vector Machines (SVM) to learn image feature characteristics for assisting the task of image classification. Based on the SVM model, we analyze which image feature is more promising in medical image retrieval. The results show that the spatial relationship between pixels is an important feature in medical image data because medical image data always has similar anatomic regions. Therefore, image features emphasizing spatial relationship have better results than others.

AB - In this paper we describe the technologies and experimental results for the medical retrieval task and automatic annotation task. We combine textual and content-based approaches to retrieve relevant medical images. The content-based approach containing four image features and the text-based approach using word expansion are developed to accomplish these tasks. Experimental results show that combining both the content-based and text-based approaches is better than using only one approach. In the automatic annotation task we use Support Vector Machines (SVM) to learn image feature characteristics for assisting the task of image classification. Based on the SVM model, we analyze which image feature is more promising in medical image retrieval. The results show that the spatial relationship between pixels is an important feature in medical image data because medical image data always has similar anatomic regions. Therefore, image features emphasizing spatial relationship have better results than others.

UR - http://www.scopus.com/inward/record.url?scp=33749619989&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33749619989&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:33749619989

SN - 354045697X

SN - 9783540456971

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 712

EP - 723

BT - Accessing Multilingual Information Repositories - 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005

PB - Springer Verlag

ER -