Back to Search
Start Over
Warning: statistical benchmarking is addictive. Kicking the habit in machine learning.
- Source :
-
Journal of Experimental & Theoretical Artificial Intelligence . Mar2010, Vol. 22 Issue 1, p67-80. 14p. - Publication Year :
- 2010
-
Abstract
- Algorithm performance evaluation is so entrenched in the machine learning community that one could call it an addiction. Like most addictions, it is harmful and very difficult to give up. It is harmful because it has serious limitations. Yet, we have great faith in practicing it in a ritualistic manner: we follow a fixed set of rules telling us the measure, the data sets and the statistical test to use. When we read a paper, even as reviewers, we are not sufficiently critical of results that follow these rules. Here, we will debate what are the limitations and how to best address them. This article may not cure the addiction but hopefully it will be a good first step along that road. [ABSTRACT FROM AUTHOR]
- Subjects :
- *ALGORITHMS
*PERFORMANCE evaluation
*MACHINE learning
*PAPER
*MACHINE theory
Subjects
Details
- Language :
- English
- ISSN :
- 0952813X
- Volume :
- 22
- Issue :
- 1
- Database :
- Academic Search Index
- Journal :
- Journal of Experimental & Theoretical Artificial Intelligence
- Publication Type :
- Academic Journal
- Accession number :
- 49144054
- Full Text :
- https://doi.org/10.1080/09528130903010295