Improved linear discriminant analysis considering empirical pairwise classification error rates

Hung Shin Lee, Berlin Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Linear discriminant analysis (LDA) is designed to seek a linear transformation that projects a data set into a lower-dimensional feature space for maximum class geometrical separability. LDA cannot always guarantee better classification accuracy, since its formulation is not in light of the properties of the classifiers, such as the automatic speech recognizer (ASR). In this paper, the relationship between the empirical classification error rates and the Mahalanobis distances of the respective class pairs of speech features is investigated, and based on this, a novel reformulation of the LDA criterion, distance-error coupled LDA (DE-LDA), is proposed. One notable characteristic of DE-LDA is that it can modulate the contribution on the between-class scatter from each class pair through the use of an empirical error function, while preserving the lightweight solvability of LDA. Experiment results seem to demonstrate that DE-LDA yields moderate improvements over LDA on the LVCSR task.

Original languageEnglish
Title of host publicationProceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008
Pages149-152
Number of pages4
DOIs
Publication statusPublished - 2008 Dec 1
Event2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008 - Kunming, China
Duration: 2008 Dec 162008 Dec 19

Publication series

NameProceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008

Other

Other2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008
CountryChina
CityKunming
Period08/12/1608/12/19

Fingerprint

Discriminant analysis
Linear transformations
Classifiers
Experiments

Keywords

  • Empirical error function
  • Feature extraction
  • Linear discriminant analysis
  • Speech recognition

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems
  • Software

Cite this

Lee, H. S., & Chen, B. (2008). Improved linear discriminant analysis considering empirical pairwise classification error rates. In Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008 (pp. 149-152). [4730303] (Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008). https://doi.org/10.1109/CHINSL.2008.ECP.49

Improved linear discriminant analysis considering empirical pairwise classification error rates. / Lee, Hung Shin; Chen, Berlin.

Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008. 2008. p. 149-152 4730303 (Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lee, HS & Chen, B 2008, Improved linear discriminant analysis considering empirical pairwise classification error rates. in Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008., 4730303, Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008, pp. 149-152, 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008, Kunming, China, 08/12/16. https://doi.org/10.1109/CHINSL.2008.ECP.49
Lee HS, Chen B. Improved linear discriminant analysis considering empirical pairwise classification error rates. In Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008. 2008. p. 149-152. 4730303. (Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008). https://doi.org/10.1109/CHINSL.2008.ECP.49
Lee, Hung Shin ; Chen, Berlin. / Improved linear discriminant analysis considering empirical pairwise classification error rates. Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008. 2008. pp. 149-152 (Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008).
@inproceedings{f0617f985c8d42dd9e0d5cd34572b20d,
title = "Improved linear discriminant analysis considering empirical pairwise classification error rates",
abstract = "Linear discriminant analysis (LDA) is designed to seek a linear transformation that projects a data set into a lower-dimensional feature space for maximum class geometrical separability. LDA cannot always guarantee better classification accuracy, since its formulation is not in light of the properties of the classifiers, such as the automatic speech recognizer (ASR). In this paper, the relationship between the empirical classification error rates and the Mahalanobis distances of the respective class pairs of speech features is investigated, and based on this, a novel reformulation of the LDA criterion, distance-error coupled LDA (DE-LDA), is proposed. One notable characteristic of DE-LDA is that it can modulate the contribution on the between-class scatter from each class pair through the use of an empirical error function, while preserving the lightweight solvability of LDA. Experiment results seem to demonstrate that DE-LDA yields moderate improvements over LDA on the LVCSR task.",
keywords = "Empirical error function, Feature extraction, Linear discriminant analysis, Speech recognition",
author = "Lee, {Hung Shin} and Berlin Chen",
year = "2008",
month = "12",
day = "1",
doi = "10.1109/CHINSL.2008.ECP.49",
language = "English",
isbn = "9781424429431",
series = "Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008",
pages = "149--152",
booktitle = "Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008",

}

TY - GEN

T1 - Improved linear discriminant analysis considering empirical pairwise classification error rates

AU - Lee, Hung Shin

AU - Chen, Berlin

PY - 2008/12/1

Y1 - 2008/12/1

N2 - Linear discriminant analysis (LDA) is designed to seek a linear transformation that projects a data set into a lower-dimensional feature space for maximum class geometrical separability. LDA cannot always guarantee better classification accuracy, since its formulation is not in light of the properties of the classifiers, such as the automatic speech recognizer (ASR). In this paper, the relationship between the empirical classification error rates and the Mahalanobis distances of the respective class pairs of speech features is investigated, and based on this, a novel reformulation of the LDA criterion, distance-error coupled LDA (DE-LDA), is proposed. One notable characteristic of DE-LDA is that it can modulate the contribution on the between-class scatter from each class pair through the use of an empirical error function, while preserving the lightweight solvability of LDA. Experiment results seem to demonstrate that DE-LDA yields moderate improvements over LDA on the LVCSR task.

AB - Linear discriminant analysis (LDA) is designed to seek a linear transformation that projects a data set into a lower-dimensional feature space for maximum class geometrical separability. LDA cannot always guarantee better classification accuracy, since its formulation is not in light of the properties of the classifiers, such as the automatic speech recognizer (ASR). In this paper, the relationship between the empirical classification error rates and the Mahalanobis distances of the respective class pairs of speech features is investigated, and based on this, a novel reformulation of the LDA criterion, distance-error coupled LDA (DE-LDA), is proposed. One notable characteristic of DE-LDA is that it can modulate the contribution on the between-class scatter from each class pair through the use of an empirical error function, while preserving the lightweight solvability of LDA. Experiment results seem to demonstrate that DE-LDA yields moderate improvements over LDA on the LVCSR task.

KW - Empirical error function

KW - Feature extraction

KW - Linear discriminant analysis

KW - Speech recognition

UR - http://www.scopus.com/inward/record.url?scp=60849105367&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=60849105367&partnerID=8YFLogxK

U2 - 10.1109/CHINSL.2008.ECP.49

DO - 10.1109/CHINSL.2008.ECP.49

M3 - Conference contribution

AN - SCOPUS:60849105367

SN - 9781424429431

T3 - Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008

SP - 149

EP - 152

BT - Proceedings - 2008 6th International Symposium on Chinese Spoken Language Processing, ISCSLP 2008

ER -