Contribution-Aware Bandwidth Allocation for Multimodal Split Learning
What it is
This paper introduces ModalShare, a method for optimizing bandwidth usage in multimodal split learning by allocating compression budgets based on each modality's contribution to the final prediction. It uses Shapley values computed on the server side to determine keep-ratios, ensuring that modalities contributing more to accuracy receive higher transmission priority without increasing total uplink traffic.
The problem it solves
Existing compression schemes for multimodal split learning allocate bandwidth equally or based on data dimension, ignoring the actual predictive contribution of each modality, which leads to suboptimal model accuracy under fixed uplink budgets.
What you could use it for
- Training multimodal AI models on edge devices with limited uplink bandwidth
- Optimizing data transmission in federated or split learning systems with multiple sensor inputs
- Improving model accuracy in resource-constrained environments where equal compression ratios are suboptimal
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.