Just Talk Once: Communication-Efficient Split Federated LLM Fine-Tuning on Edge Devices
What it is
This paper proposes L-shaped SFT and one-shot SFT, frameworks for split federated fine-tuning of LLMs on edge devices. It leverages weight tying to compute loss on the server side, eliminating bidirectional communication loops and allowing clients to go offline after a single upload.
The problem it solves
Conventional split federated fine-tuning requires continuous bidirectional communication and client involvement, which is unsustainable for edge devices with limited bandwidth and connectivity.
What you could use it for
- Fine-tuning LLMs on commercial smartphones with limited battery and connectivity
- Federated learning scenarios where clients have intermittent network access
- Reducing communication overhead in split federated learning systems
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.