Back to Search
Start Over
Knowledge distillation for multi-depth-model-fusion recommendation algorithm.
- Source :
- PLoS ONE; 10/25/2022, Vol. 17 Issue 10, p1-19, 19p
- Publication Year :
- 2022
-
Abstract
- Recommendation algorithms save a lot of valuable time for people to get the information they are interested in. However, the feature calculation and extraction process of each machine learning or deep learning recommendation algorithm are different, so how to obtain various features with different dimensions, i.e., how to integrate the advantages of each model and improve the model inference efficiency, becomes the focus of this paper. In this paper, a better deep learning model is obtained by integrating several cutting-edge deep learning models. Meanwhile, to make the integrated learning model converge better and faster, the parameters of the integrated module are initialized, constraints are imposed, and a new activation function is designed for better integration of the sub-models. Finally, the integrated large model is distilled for knowledge distillation, which greatly reduces the number of model parameters and improves the model inference efficiency. [ABSTRACT FROM AUTHOR]
- Subjects :
- DEEP learning
MACHINE learning
ALGORITHMS
FEATURE extraction
Subjects
Details
- Language :
- English
- ISSN :
- 19326203
- Volume :
- 17
- Issue :
- 10
- Database :
- Complementary Index
- Journal :
- PLoS ONE
- Publication Type :
- Academic Journal
- Accession number :
- 159840215
- Full Text :
- https://doi.org/10.1371/journal.pone.0275955