Journals Information
Computational Research(CEASE PUBLICATION) Vol. 1(1), pp. 1 - 9
DOI: 10.13189/cr.2013.010101
Reprint (PDF) (573Kb)
Probabilistic Classification from a K-Nearest-Neighbour Classifier
Charles D Mallah*, James Orwell
Kingston University, Kingston upon Thames, London, United Kingdom
ABSTRACT
K-nearest-neighbours is a simple classifier, and with increasing size of training set, the accuracy of its class predictions can be made asymptotic to the upper bound. Probabilistic classifications can also be generated: the accuracy of a simple proportional scheme will also be asymptotic to the upper bound, in the case of large training sets. Outside this limit, this and other existing schemes make ineffective use of the available information: this paper proposes a more accurate method that improves the state-of-the-art performance, evaluated on several public data sets. Criteria such as the degree of unanimity among the neighbors, the observed rank of the correct class, and the intra-class confusion matrix can be used to tabulate the observed classification accuracy within the (cross-validated) training set. These tables can then be used to make probabilistic class predictions for the previously unseen test set, used to evaluate the novel and previous methods in two ways: i) mean a posteriori probability and ii) accuracy of the discrete prediction obtained from integrating the probabilistic estimates from independent sources. The proposed method performs particularly well in the limit of small training set sizes.
KEYWORDS
Pattern Recognition, Plant Leaves Classification, k-Nearest Neighbours, Density Estimators, Combining Features
Cite This Paper in IEEE or APA Citation Styles
(a). IEEE Format:
[1] Charles D Mallah , James Orwell , "Probabilistic Classification from a K-Nearest-Neighbour Classifier," Computational Research(CEASE PUBLICATION), Vol. 1, No. 1, pp. 1 - 9, 2013. DOI: 10.13189/cr.2013.010101.
(b). APA Format:
Charles D Mallah , James Orwell (2013). Probabilistic Classification from a K-Nearest-Neighbour Classifier. Computational Research(CEASE PUBLICATION), 1(1), 1 - 9. DOI: 10.13189/cr.2013.010101.