Back to Search Start Over

A Survey of Deep Active Learning.

Authors :
PENGZHEN REN
YUN XIAO
XIAOJUN CHANG
PO-YAO HUANG
ZHIHUI LI
GUPTA, BRIJ B.
XIAOJIANG CHEN
XIN WANG
Source :
ACM Computing Surveys; Dec2022, Vol. 54 Issue 9, p1-40, 40p
Publication Year :
2022

Abstract

Active learning (AL) attempts to maximize a model's performance gain while annotating the fewest samples possible. Deep learning (DL) is greedy for data and requires a large amount of data supply to optimize a massive number of parameters if the model is to learn how to extract high-quality features. In recent years, due to the rapid development of internet technology, we have entered an era of information abundance characterized by massive amounts of available data. As a result, DL has attracted signiicant attention from researchers and has been rapidly developed. Compared with DL, however, researchers have a relatively low interest in AL. This is mainly because before the rise of DL, traditional machine learning requires relatively few labeled samples, meaning that early AL is rarely according the value it deserves. Although DL has made breakthroughs in various ields, most of this success is due to a large number of publicly available annotated datasets. However, the acquisition of a large number of high-quality annotated datasets consumes a lot of manpower, making it unfeasible in ields that require high levels of expertise (such as speech recognition, information extraction, medical images, etc.). Therefore, AL is gradually coming to receive the attention it is due. It is therefore natural to investigate whether AL can be used to reduce the cost of sample annotation while retaining the powerful learning capabilities of DL. As a result of such investigations, deep active learning (DeepAL) has emerged. Although research on this topic is quite abundant, there has not yet been a comprehensive survey of DeepAL-related works; accordingly, this article aims to ill this gap. We provide a formal classiicationmethod for the existing work, along with a comprehensive and systematic overview. In addition, we also analyze and summarize the development of DeepAL from an application perspective. Finally, we discuss the confusion and problems associated with DeepAL and provide some possible development directions. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
03600300
Volume :
54
Issue :
9
Database :
Complementary Index
Journal :
ACM Computing Surveys
Publication Type :
Academic Journal
Accession number :
154231605
Full Text :
https://doi.org/10.1145/3472291