Back to Search Start Over

Embed First, Then Predict.

Authors :
Shenghui Wang
Koopman, Rob
Source :
Knowledge Organization; 2019, Vol. 46 Issue 5, p364-370, 7p, 1 Diagram, 2 Charts, 1 Graph
Publication Year :
2019

Abstract

Automatic subject prediction is a desirable feature for modern digital library systems, as manual indexing can no longer cope with the rapid growth of digital collections. It is also desirable to be able to identify a small set of entities (e.g., authors, citations, bibliographic records) which are most relevant to a query. This gets more difficult when the amount of data increases dramatically. Data sparsity and model scalability are the major challenges to solving this type of extreme multi-label classification problem automatically. In this paper, we propose to address this problem in two steps: we first embed different types of entities into the same semantic space, where similarity could be computed easily; second, we propose a novel non-parametric method to identify the most relevant entities in addition to direct semantic similarities. We show how effectively this approach predicts even very specialised subjects, which are associated with few documents in the training set and are more problematic for a classifier. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09437444
Volume :
46
Issue :
5
Database :
Supplemental Index
Journal :
Knowledge Organization
Publication Type :
Academic Journal
Accession number :
137616884
Full Text :
https://doi.org/10.5771/0943-7444-2019-5-364