Probabilistic semantic component descriptor

Cheng Chieh Chiang, Jia Wei Wu, Greg C. Lee

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

This paper proposes the probabilistic semantic component descriptor (PSCD) for automatically extracting semantic information in a set of images. The basic idea of the PSCD is first to identify what kinds of hidden semantic concepts associated with regions in a set of images and then to construct an image-based descriptor by integrating hidden concepts of regions in an image. First, low-level features of regions in images are quantized into a set of visual words. Visual words for representing region features and high-level concepts hidden in images are linked together using the unsupervised method probabilistic latent semantic analysis. The linkage of visual words and images is built on the entire set of images, and hence a set of hidden concepts to describe each of the regions is extracted. Next, regions with unreliable concepts are eliminated, and then a PSCD for each image is constructed by propagating the probabilities of hidden concepts in the remaining regions of an image. We also present quantitative experiments to demonstrate the performance of our proposed PSCD.

Original languageEnglish
Pages (from-to)629-643
Number of pages15
JournalMultimedia Tools and Applications
Volume59
Issue number2
DOIs
Publication statusPublished - 2012 Jul 1

Fingerprint

Semantics
Experiments

Keywords

  • Hidden concepts
  • Probabilistic latent semantic analysis
  • Semantic gap
  • Visual words

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

Probabilistic semantic component descriptor. / Chiang, Cheng Chieh; Wu, Jia Wei; Lee, Greg C.

In: Multimedia Tools and Applications, Vol. 59, No. 2, 01.07.2012, p. 629-643.

Research output: Contribution to journalArticle

Chiang, Cheng Chieh ; Wu, Jia Wei ; Lee, Greg C. / Probabilistic semantic component descriptor. In: Multimedia Tools and Applications. 2012 ; Vol. 59, No. 2. pp. 629-643.
@article{3b9fe44697594506b10f74e7ab6e5352,
title = "Probabilistic semantic component descriptor",
abstract = "This paper proposes the probabilistic semantic component descriptor (PSCD) for automatically extracting semantic information in a set of images. The basic idea of the PSCD is first to identify what kinds of hidden semantic concepts associated with regions in a set of images and then to construct an image-based descriptor by integrating hidden concepts of regions in an image. First, low-level features of regions in images are quantized into a set of visual words. Visual words for representing region features and high-level concepts hidden in images are linked together using the unsupervised method probabilistic latent semantic analysis. The linkage of visual words and images is built on the entire set of images, and hence a set of hidden concepts to describe each of the regions is extracted. Next, regions with unreliable concepts are eliminated, and then a PSCD for each image is constructed by propagating the probabilities of hidden concepts in the remaining regions of an image. We also present quantitative experiments to demonstrate the performance of our proposed PSCD.",
keywords = "Hidden concepts, Probabilistic latent semantic analysis, Semantic gap, Visual words",
author = "Chiang, {Cheng Chieh} and Wu, {Jia Wei} and Lee, {Greg C.}",
year = "2012",
month = "7",
day = "1",
doi = "10.1007/s11042-011-0726-0",
language = "English",
volume = "59",
pages = "629--643",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",
number = "2",

}

TY - JOUR

T1 - Probabilistic semantic component descriptor

AU - Chiang, Cheng Chieh

AU - Wu, Jia Wei

AU - Lee, Greg C.

PY - 2012/7/1

Y1 - 2012/7/1

N2 - This paper proposes the probabilistic semantic component descriptor (PSCD) for automatically extracting semantic information in a set of images. The basic idea of the PSCD is first to identify what kinds of hidden semantic concepts associated with regions in a set of images and then to construct an image-based descriptor by integrating hidden concepts of regions in an image. First, low-level features of regions in images are quantized into a set of visual words. Visual words for representing region features and high-level concepts hidden in images are linked together using the unsupervised method probabilistic latent semantic analysis. The linkage of visual words and images is built on the entire set of images, and hence a set of hidden concepts to describe each of the regions is extracted. Next, regions with unreliable concepts are eliminated, and then a PSCD for each image is constructed by propagating the probabilities of hidden concepts in the remaining regions of an image. We also present quantitative experiments to demonstrate the performance of our proposed PSCD.

AB - This paper proposes the probabilistic semantic component descriptor (PSCD) for automatically extracting semantic information in a set of images. The basic idea of the PSCD is first to identify what kinds of hidden semantic concepts associated with regions in a set of images and then to construct an image-based descriptor by integrating hidden concepts of regions in an image. First, low-level features of regions in images are quantized into a set of visual words. Visual words for representing region features and high-level concepts hidden in images are linked together using the unsupervised method probabilistic latent semantic analysis. The linkage of visual words and images is built on the entire set of images, and hence a set of hidden concepts to describe each of the regions is extracted. Next, regions with unreliable concepts are eliminated, and then a PSCD for each image is constructed by propagating the probabilities of hidden concepts in the remaining regions of an image. We also present quantitative experiments to demonstrate the performance of our proposed PSCD.

KW - Hidden concepts

KW - Probabilistic latent semantic analysis

KW - Semantic gap

KW - Visual words

UR - http://www.scopus.com/inward/record.url?scp=84861889760&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84861889760&partnerID=8YFLogxK

U2 - 10.1007/s11042-011-0726-0

DO - 10.1007/s11042-011-0726-0

M3 - Article

AN - SCOPUS:84861889760

VL - 59

SP - 629

EP - 643

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

IS - 2

ER -