Reinforcement Learning with Conformal Action Sets: An Application to Sequential Recommendation
What it is
This paper proposes Reinforcement Learning with Calibrated Pruning (RLCP), a method that dynamically adjusts the size of the action set in sequential recommendation systems using critic scores and an online threshold. It provides theoretical bounds on reward loss and demonstrates improved catalog diversity compared to fixed-slate baselines.
The problem it solves
Fixed slate sizes in sequential recommenders are inefficient because they do not adapt to the varying number of useful alternatives available within a user session.
What you could use it for
- Sequential recommendation systems where the number of relevant items varies per session
- Optimizing catalog diversity in streaming or e-commerce platforms
- Adaptive action space management in reinforcement learning agents
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.