Back to Search Start Over

GReFEL: Geometry-Aware Reliable Facial Expression Learning under Bias and Imbalanced Data Distribution

Authors :
Wasi, Azmine Toushik
Rafi, Taki Hasan
Islam, Raima
Serbetar, Karlo
Chae, Dong Kyu
Publication Year :
2024

Abstract

Reliable facial expression learning (FEL) involves the effective learning of distinctive facial expression characteristics for more reliable, unbiased and accurate predictions in real-life settings. However, current systems struggle with FEL tasks because of the variance in people's facial expressions due to their unique facial structures, movements, tones, and demographics. Biased and imbalanced datasets compound this challenge, leading to wrong and biased prediction labels. To tackle these, we introduce GReFEL, leveraging Vision Transformers and a facial geometry-aware anchor-based reliability balancing module to combat imbalanced data distributions, bias, and uncertainty in facial expression learning. Integrating local and global data with anchors that learn different facial data points and structural features, our approach adjusts biased and mislabeled emotions caused by intra-class disparity, inter-class similarity, and scale sensitivity, resulting in comprehensive, accurate, and reliable facial expression predictions. Our model outperforms current state-of-the-art methodologies, as demonstrated by extensive experiments on various datasets.<br />Comment: ACCV 2024. Extended version of ARBEx (arXiv:2305.01486)

Details

Database :
arXiv
Publication Type :
Report
Accession number :
edsarx.2410.15927
Document Type :
Working Paper