Back to Search
Start Over
Distillate a Sparse-Meta Time Series Classifier for Open Radio Access Network-Based Cellular Vehicle-to-Everything
Distillate a Sparse-Meta Time Series Classifier for Open Radio Access Network-Based Cellular Vehicle-to-Everything
- Source :
- IEEE Transactions on Vehicular Technology; 2024, Vol. 73 Issue: 7 p9262-9271, 10p
- Publication Year :
- 2024
-
Abstract
- Deep learning-based univariate time series classification can improve the user experience of Open Radio Access Network (ORAN)-based Cellular Vehicle-to-Everything (CV2x). However, few institutes researching ORAD-based CV2x can satisfy the enormous demand of labeled data. This issue is known as few-shot learning. Thus, we deeply explore the issue of few-shot learning for ORAE-based CV2x. Meta-transfer learning is a good alternative to solving few-shot learning. Most of them, however, are still plagued by catastrophic forgetting. Numerous studies have demonstrated that deliberately applying gradient sparsity can significantly increase a meta-model's capacity for generalization. In this article, we propose a pre-training framework named Distilling for Sparse-Meta-transfer Learning (DSML). It is a combination and enhancement of meta-transfer learning, multi-teacher knowledge distillation, and sparse Model-Agnostic Meta-Learning (sparse-MAML). It utilizes multi-teacher knowledge distillation to address the catastrophic forgetting in the meta-learning phase. Simultaneously, it utilizes sigmoid function to fundamentally address the gradient anomaly problem of sparse-MAML. We conducted ablation experiments on Sparse-MAML and prove that it can actually increase the meta-model's generalization capacity. We also compare DSML with the state-of-the-art algorithm in the univariate time series classification field. The results demonstrate that DSML performs better. Finally, we present two case studies of applying DSML to ORAN-based CV2x.
Details
- Language :
- English
- ISSN :
- 00189545
- Volume :
- 73
- Issue :
- 7
- Database :
- Supplemental Index
- Journal :
- IEEE Transactions on Vehicular Technology
- Publication Type :
- Periodical
- Accession number :
- ejs66997216
- Full Text :
- https://doi.org/10.1109/TVT.2023.3323279