A Hybrid Evaluation Metric for Optimizing Classifier

Hossin, M. and Sulaiman, M.N and Mustapha, A. and Mustapha, N. and Rahmat, R.W (2011) A Hybrid Evaluation Metric for Optimizing Classifier. In: 3rd Conference on Data Mining and Optimization (DMO) 28-29 June 2011, Selangor Malaysia, 28-29 June 2011, Putrajaya.

[img]
Preview
PDF
A Hybrid Evaluation Metric for Optimizing Classifier.pdf

Download (571kB) | Preview

Abstract

The accuracy metric has been widely used for discriminating and selecting an optimal solution in constructing an optimized classifier. However, the use of accuracy metric leads the searching process to the sub-optimal solutions due to its limited capability of discriminating values. In this study, we propose a hybrid evaluation metric, which combines the accuracy metric with the precision and recall metrics. We call this new performance metric as Optimized Accuracy with Recall-Precision (OARP). This paper demonstrates that the OARP metric is more discriminating than the accuracy metric using two counter-examples. To verify this advantage, we conduct an empirical verification using a statistical discriminative analysis to prove that the OARP is statistically more discriminating than the accuracy metric. We also empirically demonstrate that a naive stochastic classification algorithm trained with the OARP metric is able to obtain better predictive results than the one trained with the conventional accuracy metric. The experiments have proved that the OARP metric is a better evaluator and optimizer in the constructing of optimized classifier.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Universiti Malaysia Sarawak, UNIMAS
Uncontrolled Keywords: Hybrid evaluation metric, Accuracy metric, Precision metric, Recall metric, Classifier optimization, 2011, Universiti Malaysia Sarawak, UNIMAS, universiti, university, Borneo, Malaysia, Sarawak, Kuching, Samarahan, IPTA, education, undergraduate, research, postgraduate
Subjects: A General Works > AC Collections. Series. Collected works
A General Works > AC Collections. Series. Collected works
Divisions: Academic Faculties, Institutes and Centres > Faculty of Cognitive Sciences and Human Development
Depositing User: Karen Kornalius
Date Deposited: 30 May 2014 01:40
Last Modified: 18 Sep 2015 07:24
URI: http://ir.unimas.my/id/eprint/3063

Actions (For repository members only: login required)

View Item View Item