TY - INPR A1 - Song, Rui A1 - Liu, Dai A1 - Chen, Dave Zhenyu A1 - Festag, Andreas A1 - Trinitis, Carsten A1 - Schulz, Martin A1 - Knoll, Alois T1 - Federated Learning via Decentralized Dataset Distillation in Resource Constrained Edge Environments N2 - In federated learning, all networked clients contribute to the model training cooperatively. However, with model sizes increasing, even sharing the trained partial models often leads to severe communication bottlenecks in underlying networks, especially when communicated iteratively. In this paper, we introduce a federated learning framework FedD3 requiring only one-shot communication by integrating dataset distillation instances. Instead of sharing model updates in other federated learning approaches, FedD3 allows the connected clients to distill the local datasets independently, and then aggregates those decentralized distilled datasets (e.g. a few unrecognizable images) from networks for model training. Our experimental results show that FedD3 significantly outperforms other federated learning frameworks in terms of needed communication volumes, while it provides the additional benefit to be able to balance the trade-off between accuracy and communication cost, depending on usage scenario or target dataset. For instance, for training an AlexNet model on CIFAR-10 with 10 clients under non-independent and identically distributed (Non-IID) setting, FedD3 can either increase the accuracy by over 71% with a similar communication volume, or save 98% of communication volume, while reaching the same accuracy, compared to other one-shot federated learning approaches. UR - https://doi.org/10.48550/arXiv.2208.11311 Y1 - 2022 UR - https://doi.org/10.48550/arXiv.2208.11311 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-60054 PB - arXiv CY - Ithaca ER - TY - INPR A1 - Song, Rui A1 - Liang, Chenwei A1 - Xia, Yan A1 - Zimmer, Walter A1 - Cao, Hu A1 - Caesar, Holger A1 - Festag, Andreas A1 - Knoll, Alois T1 - CoDa-4DGS: Dynamic Gaussian Splatting with Context and Deformation Awareness for Autonomous Driving N2 - Dynamic scene rendering opens new avenues in autonomous driving by enabling closed-loop simulations with photorealistic data, which is crucial for validating end-to-end algorithms. However, the complex and highly dynamic nature of traffic environments presents significant challenges in accurately rendering these scenes. In this paper, we introduce a novel 4D Gaussian Splatting (4DGS) approach, which incorporates context and temporal deformation awareness to improve dynamic scene rendering. Specifically, we employ a 2D semantic segmentation foundation model to self-supervise the 4D semantic features of Gaussians, ensuring meaningful contextual embedding. Simultaneously, we track the temporal deformation of each Gaussian across adjacent frames. By aggregating and encoding both semantic and temporal deformation features, each Gaussian is equipped with cues for potential deformation compensation within 3D space, facilitating a more precise representation of dynamic scenes. Experimental results show that our method improves 4DGS's ability to capture fine details in dynamic scene rendering for autonomous driving and outperforms other self-supervised methods in 4D reconstruction and novel view synthesis. Furthermore, CoDa-4DGS deforms semantic features with each Gaussian, enabling broader applications. UR - https://doi.org/10.48550/arXiv.2503.06744 Y1 - 2025 UR - https://doi.org/10.48550/arXiv.2503.06744 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-58313 PB - arXiv CY - Ithaca ER - TY - CHAP A1 - Song, Rui A1 - Festag, Andreas A1 - Jagtap, Abhishek Dinkar A1 - Bialdyga, Maximilian A1 - Yan, Zhiran A1 - Otte, Maximilian A1 - Sadashivaiah, Sanath Tiptur A1 - Knoll, Alois T1 - First Mile: An Open Innovation Lab for Infrastructure-Assisted Cooperative Intelligent Transportation Systems T2 - 2024 IEEE Intelligent Vehicles Symposium (IV) UR - https://doi.org/10.1109/IV55156.2024.10588500 Y1 - 2024 UR - https://doi.org/10.1109/IV55156.2024.10588500 SN - 979-8-3503-4881-1 SP - 1635 EP - 1642 PB - IEEE CY - Piscataway ER - TY - CHAP A1 - Song, Rui A1 - Liu, Dai A1 - Chen, Dave Zhenyu A1 - Festag, Andreas A1 - Trinitis, Carsten A1 - Schulz, Martin A1 - Knoll, Alois T1 - Federated Learning via Decentralized Dataset Distillation in Resource-Constrained Edge Environments T2 - IJCNN 2023 Conference Proceedings UR - https://doi.org/10.1109/IJCNN54540.2023.10191879 Y1 - 2023 UR - https://doi.org/10.1109/IJCNN54540.2023.10191879 SN - 978-1-6654-8867-9 PB - IEEE CY - Piscataway ER - TY - CHAP A1 - Agrawal, Shiva A1 - Song, Rui A1 - Doycheva, Kristina A1 - Knoll, Alois A1 - Elger, Gordon ED - Klein, Cornel ED - Jarke, Matthias ED - Ploeg, Jeroen ED - Helfert, Markus ED - Berns, Karsten ED - Gusikhin, Oleg T1 - Intelligent Roadside Infrastructure for Connected Mobility T2 - Smart Cities, Green Technologies, and Intelligent Transport Systems: 11th International Conference, SMARTGREENS 2022 and 8th International Conference, VEHITS 2022: Revised Selected Papers UR - https://doi.org/10.1007/978-3-031-37470-8_6 Y1 - 2023 UR - https://doi.org/10.1007/978-3-031-37470-8_6 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-41761 SN - 978-3-031-37470-8 SN - 1865-0937 SP - 134 EP - 157 PB - Springer CY - Cham ER - TY - JOUR A1 - Song, Rui A1 - Zhou, Liguo A1 - Lyu, Lingjuan A1 - Festag, Andreas A1 - Knoll, Alois T1 - ResFed: Communication-Efficient Federated Learning With Deep Compressed Residuals JF - IEEE Internet of Things Journal N2 - Federated learning allows for cooperative training among distributed clients by sharing their locally learned model parameters, such as weights or gradients. However, as model size increases, the communication bandwidth required for deployment in wireless networks becomes a bottleneck. To address this, we propose a residual-based federated learning framework (ResFed) that transmits residuals instead of gradients or weights in networks. By predicting model updates at both clients and the server, residuals are calculated as the difference between updated and predicted models and contain more dense information than weights or gradients. We find that the residuals are less sensitive to an increasing compression ratio than other parameters, and hence use lossy compression techniques on residuals to improve communication efficiency for training in federated settings. With the same compression ratio, ResFed outperforms current methods (weight- or gradient-based federated learning) by over 1.4× on federated data sets, including MNIST, FashionMNIST, SVHN, CIFAR-10, CIFAR-100, and FEMNIST, in client-to-server communication, and can also be applied to reduce communication costs for server-to-client communication. UR - https://doi.org/10.1109/JIOT.2023.3324079 Y1 - 2023 UR - https://doi.org/10.1109/JIOT.2023.3324079 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-46371 SN - 2327-4662 VL - 11 IS - 6 SP - 9458 EP - 9472 PB - IEEE CY - New York ER - TY - JOUR A1 - Hegde, Anupama A1 - Song, Rui A1 - Festag, Andreas T1 - Radio Resource Allocation in 5G-NR V2X: A Multi-Agent Actor-Critic Based Approach JF - IEEE Access N2 - The efficiency of radio resource allocation and scheduling procedures in Cellular Vehicle-to-X (Cellular V2X) communication networks directly affects link quality in terms of latency and reliability. However, owing to the continuous movement of vehicles, it is impossible to have a centralized coordinating unit at all times to manage the allocation of radio resources. In the unmanaged mode of the fifth generation new radio (5G-NR) V2X, the sensing-based semi-persistent scheduling (SB-SPS) loses its effectiveness when V2X data messages become aperiodic with varying data sizes. This leads to misinformed resource allocation decisions among vehicles and frequent resource collisions. To improve resource selection, this study formulates the Cellular V2X communication network as a decentralized multi-agent networked markov decision process (MDP) where each vehicle agent executes an actor-critic-based radio resource scheduler. Developing further the actor-critic methodology for the radio resource allocation problem in Cellular V2X, two variants are derived: independent actor-critic (IAC) and shared experience actor-critic (SEAC). Results from simulation studies indicate that the actor-critic schedulers improve reliability, achieving a 15-20% higher probability of reception under high vehicular density scenarios with aperiodic traffic patterns. UR - https://doi.org/10.1109/ACCESS.2023.3305267 KW - Cellular V2X KW - radio resource allocation KW - deep reinforcement learning Y1 - 2023 UR - https://doi.org/10.1109/ACCESS.2023.3305267 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-39352 SN - 2169-3536 VL - 11 SP - 87225 EP - 87244 PB - IEEE CY - New York ER - TY - INPR A1 - Song, Rui A1 - Zhou, Liguo A1 - Lyu, Lingjuan A1 - Festag, Andreas A1 - Knoll, Alois T1 - ResFed: Communication Efficient Federated Learning by Transmitting Deep Compressed Residuals UR - https://doi.org/10.48550/arXiv.2212.05602 Y1 - 2022 UR - https://doi.org/10.48550/arXiv.2212.05602 PB - arXiv CY - Ithaca ER - TY - CHAP A1 - Festag, Andreas A1 - Song, Rui T1 - Analysis of Existing Approaches for Information Sharing in Cooperative Intelligent Transport Systems BT - SENSORIS and V2X Messaging T2 - FISITA World Congress 2021 Y1 - 2021 UR - https://www.fisita.com/library/f2020-acm-012 N1 - Schreibfehler im Titel auf Website der FISITA Library: "Analysis of Existing Approaches for Information Sharingin Cooperative Intelligent Transport Systems" PB - FISITA CY - Bishops Stortford ER - TY - CHAP A1 - Song, Rui A1 - Hegde, Anupama A1 - Senel, Numan A1 - Knoll, Alois A1 - Festag, Andreas T1 - Edge-Aided Sensor Data Sharing in Vehicular Communication Networks T2 - 2022 IEEE 95th Vehicular Technology Conference: (VTC2022-Spring) Proceedings UR - https://doi.org/10.1109/VTC2022-Spring54318.2022.9860849 KW - sensor data sharing and fusion KW - cooperative perception KW - vehicular communication KW - distributed estimation KW - measurement noise Y1 - 2022 UR - https://doi.org/10.1109/VTC2022-Spring54318.2022.9860849 SN - 978-1-6654-8243-1 SN - 2577-2465 PB - IEEE CY - Piscataway (NJ) ER -