1. Radiance Field Delta Video Compression in Edge-Enabled Vehicular Metaverse
- Author
-
Dopiriak, Matúš, Šlapak, Eugen, Gazda, Juraj, Gurjar, Devendra S., Faruque, Mohammad Abdullah Al, and Levorato, Marco
- Subjects
Electrical Engineering and Systems Science - Signal Processing ,Computer Science - Information Theory ,Computer Science - Networking and Internet Architecture - Abstract
Connected and autonomous vehicles (CAVs) offload computationally intensive tasks to multi-access edge computing (MEC) servers via vehicle-to-infrastructure (V2I) communication, enabling applications within the vehicular metaverse, which transforms physical environment into the digital space enabling advanced analysis or predictive modeling. A core challenge is physical-to-virtual (P2V) synchronization through digital twins (DTs), reliant on MEC networks and ultra-reliable low-latency communication (URLLC). To address this, we introduce radiance field (RF) delta video compression (RFDVC), which uses RF-encoder and RF-decoder architecture using distributed RFs as DTs storing photorealistic 3D urban scenes in compressed form. This method extracts differences between CAV-frame capturing actual traffic and RF-frame capturing empty scene from the same pose in batches encoded and transmitted over the MEC network. Experiments show data savings up to 71% against H.264 codec and 44% against H.265 codec under different conditions as lighting changes, and rain. RFDVC also demonstrates resilience to transmission errors, achieving up to +0.29 structural similarity index measure (SSIM) improvement at block error rate (BLER) = 0.35 in non-rainy and +0.25 at BLER = 0.2 in rainy conditions, ensuring superior visual quality compared to standard video coding (VC) methods across various conditions., Comment: 1. III. Formulation of the problem -> introducing an advanced mathematical description. 2. IV. B Delta Segmentation -> updated Delta segmentation (DS) algorithm using mathematical description and Fig. 3 using a YOLOv11 model. 3. Updated Fig. 5. 4. V. Experimental Results -> updated Gilbert-Elliott packet loss simulation model at NAL units with BLER vs SSIM plots, corrupted frames in the Fig. 9
- Published
- 2024