Back to Search Start Over

Distillate a Sparse-Meta Time Series Classifier for Open Radio Access Network-Based Cellular Vehicle-to-Everything

Distillate a Sparse-Meta Time Series Classifier for Open Radio Access Network-Based Cellular Vehicle-to-Everything

Authors :
Sun, Le
Liang, Jiancong
Muhammad, Ghulam
Source :
IEEE Transactions on Vehicular Technology; 2024, Vol. 73 Issue: 7 p9262-9271, 10p
Publication Year :
2024

Abstract

Deep learning-based univariate time series classification can improve the user experience of Open Radio Access Network (ORAN)-based Cellular Vehicle-to-Everything (CV2x). However, few institutes researching ORAD-based CV2x can satisfy the enormous demand of labeled data. This issue is known as few-shot learning. Thus, we deeply explore the issue of few-shot learning for ORAE-based CV2x. Meta-transfer learning is a good alternative to solving few-shot learning. Most of them, however, are still plagued by catastrophic forgetting. Numerous studies have demonstrated that deliberately applying gradient sparsity can significantly increase a meta-model's capacity for generalization. In this article, we propose a pre-training framework named Distilling for Sparse-Meta-transfer Learning (DSML). It is a combination and enhancement of meta-transfer learning, multi-teacher knowledge distillation, and sparse Model-Agnostic Meta-Learning (sparse-MAML). It utilizes multi-teacher knowledge distillation to address the catastrophic forgetting in the meta-learning phase. Simultaneously, it utilizes sigmoid function to fundamentally address the gradient anomaly problem of sparse-MAML. We conducted ablation experiments on Sparse-MAML and prove that it can actually increase the meta-model's generalization capacity. We also compare DSML with the state-of-the-art algorithm in the univariate time series classification field. The results demonstrate that DSML performs better. Finally, we present two case studies of applying DSML to ORAN-based CV2x.

Details

Language :
English
ISSN :
00189545
Volume :
73
Issue :
7
Database :
Supplemental Index
Journal :
IEEE Transactions on Vehicular Technology
Publication Type :
Periodical
Accession number :
ejs66997216
Full Text :
https://doi.org/10.1109/TVT.2023.3323279