Back to Search
Start Over
Optimal Training Sets for Bayesian Prediction of MeSH® Assignment
- Publication Year :
- 2008
- Publisher :
- American Medical Informatics Association, 2008.
-
Abstract
- Objectives: The aim of this study was to improve naive Bayes prediction of Medical Subject Headings (MeSH) assignment to documents using optimal training sets found by an active learning inspired method. Design: The authors selected 20 MeSH terms whose occurrences cover a range of frequencies. For each MeSH term, they found an optimal training set, a subset of the whole training set. An optimal training set consists of all documents including a given MeSH term (C1 class) and those documents not including a given MeSH term (C1 class) that are closest to the C1 class. These small sets were used to predict MeSH assignments in the MEDLINE ® database. Measurements: Average precision was used to compare MeSH assignment using the naive Bayes learner trained on the whole training set, optimal sets, and random sets. The authors compared 95% lower confidence limits of average precisions of naive Bayes with upper bounds for average precisions of a K-nearest neighbor (KNN) classifier. Results: For all 20 MeSH assignments, the optimal training sets produced nearly 200% improvement over use of the whole training sets. In 17 of those MeSH assignments, naive Bayes using optimal training sets was statistically better than a KNN. In 15 of those, optimal training sets performed better than optimized feature selection. Overall naive Bayes averaged 14% better than a KNN for all 20 MeSH assignments. Using these optimal sets with another classifier, C-modified least squares (CMLS), produced an additional 6% improvement over naive Bayes. Conclusion: Using a smaller optimal training set greatly improved learning with naive Bayes. The performance is superior to a KNN. The small training set can be used with other sophisticated learning methods, such as CMLS, where using the whole training set would not be feasible.
- Subjects :
- Class (set theory)
Active learning (machine learning)
business.industry
Abstracting and Indexing
Supervised learning
Health Informatics
Feature selection
Pattern recognition
Bayes Theorem
Machine learning
computer.software_genre
Least squares
Range (mathematics)
Naive Bayes classifier
Medical Subject Headings
Artificial Intelligence
Classifier (linguistics)
Artificial intelligence
business
computer
Algorithms
Mathematics
Research Paper
Natural Language Processing
Subjects
Details
- Language :
- English
- Database :
- OpenAIRE
- Accession number :
- edsair.doi.dedup.....6da35c8c381bf1fa61d118d1c572de8e