Published in

Wiley, Journal of Chemometrics, 1(30), p. 37-45, 2015

DOI: 10.1002/cem.2768

Links

Tools

Export citation

Search in Google Scholar

Correlation-assisted nearest shrunken centroid classifier with applications for high dimensional spectral data: CA-NSC with applications for high dimensional spectral data

Journal article published in 2015 by Jian Xu, Qingsong Xu, Lunzhao Yi, Chi-On Chan, Daniel Kam-Wah Mok ORCID
This paper is available in a repository.
This paper is available in a repository.

Full text: Download

Green circle
Preprint: archiving allowed
Orange circle
Postprint: archiving restricted
Red circle
Published version: archiving forbidden
Data provided by SHERPA/RoMEO

Abstract

High throughput data are frequently observed in contemporary chemical studies. Classification through spectral information is an important issue in chemometrics. Linear discriminant analysis (LDA) fails in the large-p-small-n situation for two main reasons: (1) the sample covariance matrix is singular when p > n and (2) there is an accumulation of noise in the estimation of the class centroid in high dimensional feature space. The Independence Rule is a class of methods used to overcome these drawbacks by ignoring the correlation information between spectral variables. However, a strong correlation is an essential characteristic of spectral data. We proposed a new correlation-assisted nearest shrunken centroid classifier (CA-NSC) to incorporate correlation information into the classification. CA-NSC combines two sources of information [class centroid (mean) and correlation structure (variance)] to generate the classification. We used two real data analyses and a simulation study to verify our CA-NSC method. In addition to NSC, we also performed a comparison with the soft independent modeling of class analogy (SIMCA) approach, which uses only correlation structure information for classification. The results show that CA-NSC consistently improves on NSC and SIMCA. The misclassification rate of CA-NSC is reduced by almost half compared with NSC in one of the real data analyses. Generally, correlation among variables will worsen the performance of NSC, even though the discriminatory information contained in the class centroid remains unchanged. If only correlation structure information is used (as in the case of SIMCA), the result will be satisfactory only when the correlation structure alone can provide sufficient information for classification.